Jump to content

Talk:Linear regression (disambiguation)

Page contents not supported in other languages.
From Wikipedia, the free encyclopedia

Reverted to redirect

[edit]

Linear regression (model)

[edit]

First of all, it’s not really appropriate to say “For the use of the term in statistics, see Linear regression model” since both uses of this term are in statistics, and therefore such phrase is equivalent to the absence of any definition.

Secondly, linear regression IS a line/hyperplane. The fact that you can nonlinearly transform the data before fitting the regression does not change it. The fact that you might transform the data back and then make a picture in which the regression line does not look like a line anymore still does not change it either. Linear regression IS the line, meaning that it reduces the 2-dimensional joint probability cloud of (y,x) to a geometric line in the 2-dimensional space. // stpasha » 17:12, 20 May 2010 (UTC)[reply]

But if you fit a parabola or a sine wave by least squares in the usual way, it's still linear regression regardless of the fact that what you're fitting is not a line nor a hyperplane. Hence the way you've written this page is incorrect. Michael Hardy (talk) 17:11, 20 May 2010 (UTC)[reply]
Fitting a parabola means that you create a new variable x², go into 3-dimensional space, and fit a plane through the points (x, x²) of that space. So it’s still a linear regression regardless of the fact that what i'm fitting is actually a hyperplane (only in a higher-dimensional space). Fitting sine wave usually requires estimating the amplitude, the phase and the frequency — that's nonlinear regression already. // stpasha »
Michael, if you don't like my definition then provide yours. But you can't leave the term undefined. // stpasha »
It is linear regression if you're projecting onto the space spanned by two columns, the ith entry of one of which is sin ti and of the other is cos ti. And that gets you amplitude and phase shift. You're confused if you think that's nonlinear regression. Michael Hardy (talk) 00:02, 21 May 2010 (UTC)[reply]
But frequency parameter makes it nonlinear: sin(ωti). But then again, it depends on the model, — maybe in some settings the frequency could be assumed to be known exogenously.  // stpasha » 
I'm not a stats expert, but I do have some background in math and linear algebra. It seems like you guys are over-analyzing this from my perspective. Why not something like:
  • linear regression (disambiguation) listing the following:
  • linear regression -> linear regression (univariate)
  • general linear model -> linear regression (multivariate)
  • generalized linear model
I'm sure you guys can improve on that, though. 70.250.178.31 (talk) 05:00, 7 June 2010 (UTC)[reply]