Stochastic incremental mirror descent algorithms with Nesterov smoothing - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

Stochastic incremental mirror descent algorithms with Nesterov smoothing

Résumé

We propose a stochastic incremental mirror descent method constructed by means of the Nesterov smoothing for minimizing a sum of finitely many proper, convex and lower semicontinuous functions over a nonempty closed convex set in a Euclidean space. The algorithm can be adapted in order to minimize (in the same setting) a sum of finitely many proper, convex and lower semicontinuous functions composed with linear operators. Another modification of the scheme leads to a stochastic incremental mirror descent Bregman-proximal scheme with Nesterov smoothing for minimizing the sum of finitely many proper, convex and lower semicontinuous functions with a prox-friendly proper, convex and lower semicontinuous function in the same framework. Different to the previous contributions from the literature on mirror descent methods for minimizing sums of functions, we do not require these to be (Lipschitz) continuous or differentiable. Applications in Logistics, Tomography and Machine Learning modeled as optimization problems illustrate the theoretical achievements.
Fichier non déposé

Dates et versions

hal-04005342 , version 1 (26-02-2023)

Identifiants

  • HAL Id : hal-04005342 , version 1

Citer

Sorin-Mihai Grad, Sandy Bitterlich. Stochastic incremental mirror descent algorithms with Nesterov smoothing. Journées SMAI MODE 2022, Loïc Bourdin, Jun 2022, Limoges, France. ⟨hal-04005342⟩
25 Consultations
0 Téléchargements

Partager

More