Imputation of mixed data with multilevel singular value decomposition - Archive ouverte HAL
Article Dans Une Revue Journal of Computational and Graphical Statistics Année : 2019

Imputation of mixed data with multilevel singular value decomposition

Résumé

Statistical analysis of large data sets offers new opportunities to better understand many processes. Yet, data accumulation often implies relaxing acquisition procedures or compounding diverse sources. As a consequence, such data sets often contain mixed data, i.e. both quantitative and qualitative and many missing values. Furthermore, aggregated data present a natural \textit{multilevel} structure, where individuals or samples are nested within different sites, such as countries or hospitals. Imputation of multilevel data has therefore drawn some attention recently, but current solutions are not designed to handle mixed data, and suffer from important drawbacks such as their computational cost. In this article, we propose a single imputation method for multilevel data, which can be used to complete either quantitative, categorical or mixed data. The method is based on multilevel singular value decomposition (SVD), which consists in decomposing the variability of the data into two components, the between and within groups variability, and performing SVD on both parts. We show on a simulation study that in comparison to competitors, the method has the great advantages of handling data sets of various size, and being computationally faster. Furthermore, it is the first so far to handle mixed data. We apply the method to impute a medical data set resulting from the aggregation of several data sets coming from different hospitals. This application falls in the framework of a larger project on Trauma patients. To overcome obstacles associated to the aggregation of medical data, we turn to distributed computation. The method is implemented in an R package.
Fichier principal
Vignette du fichier
distcomp_imputation_JCGS.pdf (373.09 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01781291 , version 1 (30-04-2018)

Identifiants

Citer

François Husson, Julie Josse, Balasubramanian Narasimhan, Geneviève Robin. Imputation of mixed data with multilevel singular value decomposition. Journal of Computational and Graphical Statistics, 2019, 28 (3), pp.552-566. ⟨10.1080/10618600.2019.1585261⟩. ⟨hal-01781291⟩
445 Consultations
560 Téléchargements

Altmetric

Partager

More