ACTIVITY IDENTIFICATION AND LOCAL LINEAR CONVERGENCE OF FORWARD–BACKWARD-TYPE METHODS - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue SIAM Journal on Optimization Année : 2017

ACTIVITY IDENTIFICATION AND LOCAL LINEAR CONVERGENCE OF FORWARD–BACKWARD-TYPE METHODS

Résumé

In this paper, we consider a class of Forward–Backward (FB) splitting methods that includes several variants (e.g. inertial schemes, FISTA) for minimizing the sum of two proper convex and lower semi-continuous functions, one of which has a Lipschitz continuous gradient, and the other is partly smooth relative to a smooth active manifold M. We propose a unified framework, under which we show that, this class of FB-type algorithms (i) correctly identifies the active manifold in a finite number of iterations (finite activity identification), and (ii) then enters a local linear convergence regime, which we characterize precisely in terms of the structure of the underlying active manifold. We also establish and explain why FISTA (with convergent sequences) locally oscillates and can be locally slower than FB. These results may have numerous applications including in signal/image processing, sparse recovery and machine learning. Indeed, the obtained results explain the typical behaviour that has been observed numerically for many problems in these fields such as the Lasso, the group Lasso, the fused Lasso and the nuclear norm minimization to name only a few.
Fichier principal
Vignette du fichier
ifb.pdf (910.92 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01658850 , version 1 (07-12-2017)

Identifiants

  • HAL Id : hal-01658850 , version 1

Citer

Jingwei Liang, Jalal M. Fadili, Gabriel Peyré. ACTIVITY IDENTIFICATION AND LOCAL LINEAR CONVERGENCE OF FORWARD–BACKWARD-TYPE METHODS. SIAM Journal on Optimization, 2017. ⟨hal-01658850⟩
294 Consultations
70 Téléchargements

Partager

Gmail Facebook X LinkedIn More