Bayesian Variable Selection for Globally Sparse Probabilistic PCA - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2016

Bayesian Variable Selection for Globally Sparse Probabilistic PCA

Résumé

With the flourishing development of high-dimensional data, sparse versions of principal component analysis (PCA) have imposed themselves as simple, yet powerful ways of selecting relevant features in an unsupervised manner. However, when several sparse principal components are computed, the interpretation of the selected variables may be difficult since each axis has its own sparsity pattern and has to be interpreted separately. To overcome this drawback, we propose a Bayesian procedure that allows to obtain several sparse components with the same sparsity pattern. This allows the practitioner to identify the original variables which are relevant to describe the data. To this end, using Roweis' probabilistic interpretation of PCA and an isotropic Gaussian prior on the loading matrix, we provide the first exact computation of the marginal likelihood of a Bayesian PCA model. In order to avoid the drawbacks of discrete model selection, we propose a simple relaxation of our framework which allows to find a path of models using a variational expectation-maximization algorithm. The exact marginal likelihood can eventually be maximized over this path, relying on Occam's razor to select the relevant variables. Since the sparsity pattern is common to all components, we call this approach globally sparse probabilistic PCA (GSPPCA). Its usefulness is illustrated on synthetic data sets and on several real unsupervised feature selection problems.
Fichier principal
Vignette du fichier
GSPPCAv1.pdf (730.03 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01310409 , version 1 (09-05-2016)
hal-01310409 , version 2 (20-09-2016)

Licence

Paternité

Identifiants

Citer

Charles Bouveyron, Pierre Latouche, Pierre-Alexandre Mattei. Bayesian Variable Selection for Globally Sparse Probabilistic PCA. 2016. ⟨hal-01310409v1⟩
769 Consultations
709 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More