Distributed SAGA: Maintaining linear convergence rate with limited communication - Archive ouverte HAL Access content directly
Preprints, Working Papers, ... Year :

Distributed SAGA: Maintaining linear convergence rate with limited communication

Clément Calauzènes
Nicolas Le Roux
  • Function : Author

Abstract

In recent years, variance-reducing stochastic methods have shown great practical performance, exhibiting linear convergence rate when other stochastic methods offered a sub-linear rate. However, as datasets grow ever bigger and clusters become widespread, the need for fast distribution methods is pressing. We propose here a distribution scheme for SAGA which maintains a linear convergence rate, even when communication between nodes is limited.

Dates and versions

hal-02457450 , version 1 (28-01-2020)

Identifiers

Cite

Clément Calauzènes, Nicolas Le Roux. Distributed SAGA: Maintaining linear convergence rate with limited communication. 2020. ⟨hal-02457450⟩
23 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More