Constant step-size stochastic approximation with delayed updates - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Constant step-size stochastic approximation with delayed updates

Résumé

In this paper, we consider constant step-size stochastic approximation with delayed updates. For the nondelayed case, it is well known that under appropriate conditions, the discrete-time iterates of stochastic approximation track the trajectory of a continuous-time ordinary differential equation (ODE). For the delayed case, we show in this paper that, under appropriate conditions, the discrete-time iterates track the trajectory of a delay-differential equation (DDE) rather than an ODE. Thus, delayed updates lead to a qualitative change in the behavior of constant step-size stochastic approximation. We present multiple examples to illustrate the qualitative affect of delay and show that increasing the delay is generally destabilizing but, for some systems, it can be stabilizing as well.

Fichier sous embargo
Fichier sous embargo
0 0 28
Année Mois Jours
Avant la publication
jeudi 19 décembre 2024
Fichier sous embargo
jeudi 19 décembre 2024
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04765003 , version 1 (04-11-2024)
hal-04765003 , version 2 (04-11-2024)

Identifiants

  • HAL Id : hal-04765003 , version 2

Citer

Aditya Mahajan, Silviu-Iulian Niculescu, Mathukumalli Vidyasagar. Constant step-size stochastic approximation with delayed updates. 2024 Conference on Decision and Control, IEEE, Dec 2024, Milan (Italie), Italy. ⟨hal-04765003v2⟩
0 Consultations
0 Téléchargements

Partager

More