The stochastic Auxiliary Problem Principle in Banach spaces: measurability and convergence - Archive ouverte HAL
Article Dans Une Revue SIAM Journal on Optimization Année : 2022

The stochastic Auxiliary Problem Principle in Banach spaces: measurability and convergence

Résumé

The stochastic Auxiliary Problem Principle (APP) algorithm is a general Stochastic Approximation (SA) scheme that turns the resolution of an original optimization problem into the iterative resolution of a sequence of auxiliary problems. This framework has been introduced to design decomposition-coordination schemes but also encompasses many well-known SA algorithms such as stochastic gradient descent or stochastic mirror descent. We study the stochastic APP in the case where the iterates lie in a Banach space and we consider an additive error on the computation of the subgradient of the objective. In order to derive convergence results or efficiency estimates for a SA scheme, the iterates must be random variables. This is why we prove the measurability of the iterates of the stochastic APP algorithm. Then, we extend convergence results from the Hilbert space case to the Banach space case. Finally, we derive efficiency estimates for the function values taken at the averaged sequence of iterates or at the last iterate, the latter being obtained by adapting the concept of modified Fejér monotonicity to our framework.
Fichier principal
Vignette du fichier
preprint_paper_ppa_v4.pdf (489.6 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03115740 , version 1 (19-01-2021)
hal-03115740 , version 2 (18-02-2022)
hal-03115740 , version 3 (20-05-2022)

Identifiants

Citer

Thomas Bittar, Pierre Carpentier, Jean-Philippe Chancelier, Jéro͂me Lonchampt. The stochastic Auxiliary Problem Principle in Banach spaces: measurability and convergence. SIAM Journal on Optimization, 2022, 32 (3), pp.1871-1900. ⟨10.1137/21M1402467⟩. ⟨hal-03115740v3⟩
137 Consultations
136 Téléchargements

Altmetric

Partager

More