Abstract
For ridge regression the degrees of freedom are commonly calculated by the trace of the matrix that transforms the vector of observations on the dependent variable into the ridge regression estimate of its expected value. For a fixed ridge parameter this is unobjectionable. When the ridge parameter is optimized on the same data, by minimization of the generalized cross validation criterion or Mallows , additional degrees of freedom are used however. We give formulae that take this into account. This allows of a proper assessment of ridge regression in competitions for the best predictor.
Original language | English |
---|---|
Pages (from-to) | 3185-3193 |
Number of pages | 9 |
Journal | Quality and Quantity |
Volume | 48 |
Issue number | 6 |
DOIs | |
Publication status | Published - Nov-2014 |
Keywords
- Ridge regression
- Degrees of freedom
- Prediction
- Cross-validation
- Stein's identity
- GENERALIZED CROSS-VALIDATION