Imputation for prediction: beware of diminishing returns - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2024

Imputation for prediction: beware of diminishing returns

Résumé

Missing values are prevalent across various fields, posing challenges for training and deploying predictive models. In this context, imputation is a common practice, driven by the hope that accurate imputations will enhance predictions. However, recent theoretical and empirical studies indicate that simple constant imputation can be consistent and competitive. This empirical study aims at clarifying if and when investing in advanced imputation methods yields significantly better predictions. Relating imputation and predictive accuracies across combinations of imputation and predictive models on 20 datasets, we show that imputation accuracy matters less i) when using expressive models, ii) when incorporating missingness indicators as complementary inputs, iii) matters much more for generated linear outcomes than for real-data outcomes. Interestingly, we also show that the use of the missingness indicator is beneficial to the prediction performance, even in MCAR scenarios. Overall, on real-data with powerful models, improving imputation only has a minor effect on prediction performance. Thus, investing in better imputations for improved predictions often offers limited benefits.

Mots clés

Fichier principal
Vignette du fichier
LeMorvan2024imputation.pdf (3.34 Mo) Télécharger le fichier
neurips_data_2024.pdf (3.15 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04662937 , version 1 (26-07-2024)

Licence

Identifiants

  • HAL Id : hal-04662937 , version 1

Citer

Marine Le Morvan, Gaël Varoquaux. Imputation for prediction: beware of diminishing returns. 2024. ⟨hal-04662937⟩
37 Consultations
18 Téléchargements

Partager

More