Constant step-size stochastic approximation with delayed updates - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Constant step-size stochastic approximation with delayed updates

Résumé

In this paper, we consider constant step-size stochastic approximation with delayed updates. For the nondelayed case, it is well known that under appropriate conditions, the discrete-time iterates of stochastic approximation track the trajectory of a continuous-time ordinary differential equation (ODE). For the delayed case, we show in this paper that, under appropriate conditions, the discrete-time iterates track the trajectory of a delay-differential equation (DDE) rather than an ODE. Thus, delayed updates lead to a qualitative change in the behavior of constant step-size stochastic approximation. We present multiple examples to illustrate the qualitative affect of delay and show that increasing the delay is generally destabilizing but, for some systems, it can be stabilizing as well.

Fichier principal
Vignette du fichier
Delayed_stochastic_approximation_DDE_approach_VF.pdf (1.79 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04765003 , version 1 (04-11-2024)
hal-04765003 , version 2 (04-11-2024)

Licence

Identifiants

  • HAL Id : hal-04765003 , version 1

Citer

Aditya Mahajan, Silviu-Iulian Niculescu, Mathukumalli Vidyasagar. Constant step-size stochastic approximation with delayed updates. CDC 2024 - Conference on Decision and Control, IEEE, Dec 2024, Milan, Italy. ⟨hal-04765003v1⟩
92 Consultations
47 Téléchargements

Partager

More