Tracing ridge regression coefficients
Article first published online: 29 SEP 2010
© 2010 John Wiley & Sons, Inc.
Wiley Interdisciplinary Reviews: Computational Statistics
Volume 2, Issue 6, pages 695–703, November/December 2010
How to Cite
McDonald, G. C. (2010), Tracing ridge regression coefficients. WIREs Comp Stat, 2: 695–703. doi: 10.1002/wics.126
- Issue published online: 22 NOV 2010
- Article first published online: 29 SEP 2010
- intraclass correlation structure;
- variance inflation factors;
- confidence ellipsoid;
- ridge trace
Ridge regression is a parameter estimation method used to address the collinearity problem frequently arising in multiple linear regressions. The methodology defines a class of estimators indexed by a non-negative scalar parameter, k. When utilizing ridge regression, the analyst eventually chooses a particular value of k which, in turn, uniquely determines the regression parameter estimates within the ridge class. Many such methods of determination, both deterministic and stochastic, have been proposed and evaluated in the literature. A plot of the ridge regression estimates as a function of k, the so-called ridge trace, is often used in the selection process. In this article, one such criterion, the square of the correlation coefficient of the actual dependent variable and its predicted values, is examined. It can be used, along with a ridge trace and other quantitative measures, as another important tradeoff between using ordinary least squares estimates and estimates from the ridge class. WIREs Comp Stat 2010 2 695–703 DOI: 10.1002/wics.126
For further resources related to this article, please visit the WIREs website.