Model-Based Variable Decorrelation in Linear Regression - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2014

Model-Based Variable Decorrelation in Linear Regression

Résumé

Linear regression outcomes (estimates, prevision) are known to be damaged by highly correlated covariates. However most modern datasets are expected to mechanically convey more and more highly correlated covariates due to the global increase of the amount of variables they contain. We propose to explicitly model such correlations by a family of linear regressions between the covariates. The structure of correlations is found with an mcmc algorithm aiming at optimizing a specific bic criterion. This hierarchical-like approach leads to a joint probability distribution on both the initial response variable and the linearly explained covariates. Then, marginalisation on the linearly explained covariates produces a parsimonious correlation-free regression model from which classical procedures for estimating regression coefficient, including any variable selection procedures, can be plugged. Both simulated and real-life datasets from steel industry, where correlated variables are frequent, highlight that this proposed covariates pretreatment-like method has two essential benefits: First, it offers a real readability of the linear links between covariates; Second, it improves significantly efficiency of classical estimation/selection methods which are performed after. An r package (CorReg), available on the cran, implements this new method.
Fichier principal
Vignette du fichier
article.pdf (632.99 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01099133 , version 1 (31-12-2014)

Identifiants

  • HAL Id : hal-01099133 , version 1

Citer

Clément Théry, Christophe Biernacki, Gaétan Loridant. Model-Based Variable Decorrelation in Linear Regression. 2014. ⟨hal-01099133⟩
208 Consultations
566 Téléchargements

Partager

Gmail Facebook X LinkedIn More