Distributed SAGA: Maintaining linear convergence rate with limited communication - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2020

Distributed SAGA: Maintaining linear convergence rate with limited communication

Clément Calauzènes
Nicolas Le Roux
  • Fonction : Auteur

Résumé

In recent years, variance-reducing stochastic methods have shown great practical performance, exhibiting linear convergence rate when other stochastic methods offered a sub-linear rate. However, as datasets grow ever bigger and clusters become widespread, the need for fast distribution methods is pressing. We propose here a distribution scheme for SAGA which maintains a linear convergence rate, even when communication between nodes is limited.

Dates et versions

hal-02457450 , version 1 (28-01-2020)

Identifiants

Citer

Clément Calauzènes, Nicolas Le Roux. Distributed SAGA: Maintaining linear convergence rate with limited communication. 2020. ⟨hal-02457450⟩
24 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More