Quantitative propagation of chaos for mean field Markov decision process with common noise - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2022

Quantitative propagation of chaos for mean field Markov decision process with common noise

Résumé

We investigate propagation of chaos for mean field Markov Decision Process with common noise (CMKV-MDP), and when the optimization is performed over randomized open-loop controls on infinite horizon. We first state a rate of convergence of order M_N^\gamma , where M_N is the mean rate of convergence in Wasserstein distance of the empirical measure, and γ \in (0,1] 1s is an explicit constant, in the limit of the value functions of N-agent control problem with asymmetric open-loop controls, towards the value function of CMKV-MDP. Furthermore, we show how to explicitly construct O(\epsilon + M_N^\gamma)-optimal policies for the N-agent model from \epsilon-optimal policies for the CMKV-MDP. Our approach relies on sharp comparison between the Bellman operators in the N-agent problem and the CMKV-MDP, and fine coupling of empirical measures.
Fichier principal
Vignette du fichier
Conv-MPjuly2022.pdf (344.39 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03737655 , version 1 (25-07-2022)

Identifiants

Citer

Médéric Motte, Huyên Pham. Quantitative propagation of chaos for mean field Markov decision process with common noise. 2022. ⟨hal-03737655⟩
27 Consultations
19 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More