Random features models: a way to study the success of naive imputation - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2024

Random features models: a way to study the success of naive imputation

Résumé

Constant (naive) imputation is still widely used in practice as this is a first easy-to-use technique to deal with missing data. Yet, this simple method could be expected to induce a large bias for prediction purposes, as the imputed input may strongly differ from the true underlying data. However, recent works suggest that this bias is low in the context of high-dimensional linear predictors when data is supposed to be missing completely at random (MCAR). This paper completes the picture for linear predictors by confirming the intuition that the bias is negligible and that surprisingly naive imputation also remains relevant in very low dimension. To this aim, we consider a unique underlying random features model, which offers a rigorous framework for studying predictive performances, whilst the dimension of the observed features varies. Building on these theoretical results, we establish finite-sample bounds on stochastic gradient (SGD) predictors applied to zero-imputed data, a strategy particularly well suited for large-scale learning. If the MCAR assumption appears to be strong, we show that similar favorable behaviors occur for more complex missing data scenarios.
Fichier principal
Vignette du fichier
main.pdf (422.95 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04440304 , version 1 (05-02-2024)

Identifiants

Citer

Alexis Ayme, Claire Boyer, Aymeric Dieuleveut, Erwan Scornet. Random features models: a way to study the success of naive imputation. 2024. ⟨hal-04440304⟩
22 Consultations
4 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More