Asynchronous gossip principal components analysis - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Neurocomputing Année : 2015

Asynchronous gossip principal components analysis

Résumé

This paper deals with Principal Components Analysis (PCA) of data spread over a network where central coordination and synchronous communication between networking nodes are forbidden. We propose an asynchronous and decentralized PCA algorithm dedicated to large scale problems, where " large " simultaneously applies to dimensionality, number of observations and network size. It is based on the integration of a dimension reduction step into a Gossip consensus protocol. Unlike other approaches, a straightforward dual formulation makes it suitable when observed dimensions are distributed. We theoretically show its equivalence with a centralized PCA under a low-rank assumption on training data. An experimental analysis reveals that it achieves a good accuracy with a reasonable communication cost even when the low-rank assumption is relaxed.
Fichier principal
Vignette du fichier
single_column.pdf (416.21 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01148639 , version 1 (05-05-2015)

Identifiants

Citer

Jerome Fellus, David Picard, Philippe-Henri Gosselin. Asynchronous gossip principal components analysis. Neurocomputing, 2015, pp.0. ⟨10.1016/j.neucom.2014.11.076⟩. ⟨hal-01148639⟩
157 Consultations
269 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More