Unsupervised domain adaptation with non-stochastic missing data - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2021

Unsupervised domain adaptation with non-stochastic missing data

Résumé

We consider unsupervised domain adaptation (UDA) for classification problems in the presence of missing data in the unlabelled target domain. More precisely, motivated by practical applications, we analyze situations where distribution shift exists between domains and where some components are systematically absent on the target domain without available supervision for imputing the missing target components. We propose a generative approach for imputation. Imputation is performed in a domain-invariant latent space and leverages indirect supervision from a complete source domain. We introduce a single model performing joint adaptation, imputation and classification which, under our assumptions, minimizes an upper bound of its target generalization error and performs well under various representative divergence families (H-divergence, Optimal Transport). Moreover, we compare the target error of our Adaptation-imputation framework and the "ideal" target error of a UDA classifier without missing target components. Our model is further improved with self-training, to bring the learned source and target class posterior distributions closer. We perform experiments on three families of datasets of different modalities: a classical digit classification benchmark, the Amazon product reviews dataset both commonly used in UDA and real-world digital advertising datasets. We show the benefits of jointly performing adaptation, classification and imputation on these datasets.
Fichier principal
Vignette du fichier
Adaptation_Imputation.pdf (2.97 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03338879 , version 1 (09-09-2021)
hal-03338879 , version 2 (15-09-2021)

Identifiants

  • HAL Id : hal-03338879 , version 1

Citer

Matthieu Kirchmeyer, Patrick Gallinari, Alain Rakotomamonjy, Amin Mantrach. Unsupervised domain adaptation with non-stochastic missing data. 2021. ⟨hal-03338879v1⟩
184 Consultations
161 Téléchargements

Partager

More