Regularized optimal transport of covariates and outcomes in data recoding - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Journal of the American Statistical Association Année : 2022

Regularized optimal transport of covariates and outcomes in data recoding

Résumé

When databases are constructed from heterogeneous sources, it is not unusual that different encodings are used for the same outcome. In such case, it is necessary to recode the outcome variable before merging two databases. The method proposed for the recoding is an application of optimal transportation where we search for a bijective mapping between the distributions of such variable in two databases. In this article, we build upon the work by Garès et al. [9], where they transport the distributions of categorical outcomes assuming that they are distributed equally in the two databases. Here, we extend the scope of the model to treat all the situations where the covariates explain the outcomes similarly in the two databases. In particular, we do not require that the outcomes be distributed equally. For this, we propose a model where joint distributions of outcomes and covariates are transported. We also propose to enrich the model by relaxing the constraints on marginal distributions and adding an L1 regularization term. The performances of the models are evaluated in a simulation study, and they are applied to a real dataset.
Fichier principal
Vignette du fichier
OTRecoding.pdf (514.27 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02123109 , version 1 (07-05-2019)

Identifiants

Citer

Valérie Garès, Jérémy Omer. Regularized optimal transport of covariates and outcomes in data recoding. Journal of the American Statistical Association, 2022, 117 (537), pp.1-14. ⟨10.1080/01621459.2020.1775615⟩. ⟨hal-02123109⟩
220 Consultations
248 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More