A vector almost-supermartingale convergence theorem and its applications - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

A vector almost-supermartingale convergence theorem and its applications

Résumé

The almost-supermartingale convergence theorem of Robbins and Siegmund (1971) is a fundamental tool for establishing the convergence of various stochastic iterative algorithms including system identification, adaptive control, and reinforcement learning. The theorem is stated for non-negative scalar valued stochastic processes. In this paper, we generalize the theorem to non-negative vector valued stochastic processes and provide two set of sufficient conditions for such processes to converge almost surely. We present several applications of vector almost-supermartingale convergence theorem, including convergence of autoregressive supermartingales, delayed supermartingales, and stochastic approximation with delayed updates.
Fichier sous embargo
Fichier sous embargo
0 0 25
Année Mois Jours
Avant la publication
lundi 16 décembre 2024
Fichier sous embargo
lundi 16 décembre 2024
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04770089 , version 1 (06-11-2024)

Licence

Identifiants

  • HAL Id : hal-04770089 , version 1

Citer

Aditya Mahajan, Silviu-Iulian Niculescu, Mathukumalli Vidyasagar. A vector almost-supermartingale convergence theorem and its applications. CDC 2024 - Conference on Decision and Control, IEEE, Dec 2024, Milan, Italy. ⟨hal-04770089⟩
0 Consultations
0 Téléchargements

Partager

More