Model-Based Variable Decorrelation in Linear Regression - Archive ouverte HAL Access content directly
Preprints, Working Papers, ... Year : 2014

Model-Based Variable Decorrelation in Linear Regression


Linear regression outcomes (estimates, prevision) are known to be damaged by highly correlated covariates. However most modern datasets are expected to mechanically convey more and more highly correlated covariates due to the global increase of the amount of variables they contain. We propose to explicitly model such correlations by a family of linear regressions between the covariates. The structure of correlations is found with an mcmc algorithm aiming at optimizing a specific bic criterion. This hierarchical-like approach leads to a joint probability distribution on both the initial response variable and the linearly explained covariates. Then, marginalisation on the linearly explained covariates produces a parsimonious correlation-free regression model from which classical procedures for estimating regression coefficient, including any variable selection procedures, can be plugged. Both simulated and real-life datasets from steel industry, where correlated variables are frequent, highlight that this proposed covariates pretreatment-like method has two essential benefits: First, it offers a real readability of the linear links between covariates; Second, it improves significantly efficiency of classical estimation/selection methods which are performed after. An r package (CorReg), available on the cran, implements this new method.
Fichier principal
Vignette du fichier
article.pdf (632.99 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-01099133 , version 1 (31-12-2014)


  • HAL Id : hal-01099133 , version 1


Clément Théry, Christophe Biernacki, Gaétan Loridant. Model-Based Variable Decorrelation in Linear Regression. 2014. ⟨hal-01099133⟩
211 View
583 Download


Gmail Mastodon Facebook X LinkedIn More