Definable Zero-Sum Stochastic Games - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Mathematics of Operations Research Année : 2015

Definable Zero-Sum Stochastic Games

Résumé

Definable zero-sum stochastic games involve a finite number of states and action sets, reward and transition functions that are definable in an o-minimal structure. Prominent examples of such games are finite, semi-algebraic or globally subanalytic stochastic games. We prove that the Shapley operator of any definable stochastic game with separable transition and reward functions is definable in the same structure. Definability in the same structure does not hold systematically: we provide a counterexample of a stochastic game with semi-algebraic data yielding a non semi-algebraic but globally subanalytic Shapley operator. %Showing the definability of the Shapley operator in full generality appears thus as a complex and challenging issue. } Our definability results on Shapley operators are used to prove that any separable definable game has a uniform value; in the case of polynomially bounded structures we also provide convergence rates. Using an approximation procedure, we actually establish that general zero-sum games with separable definable transition functions have a uniform value. These results highlight the key role played by the tame structure of transition functions. As particular cases of our main results, we obtain that stochastic games with polynomial transitions, definable games with finite actions on one side, definable games with perfect information or switching controls have a uniform value. Applications to nonlinear maps arising in risk sensitive control and Perron-Frobenius theory are also given.
Fichier principal
Vignette du fichier
BGV-revisedFINAL.pdf (572.27 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00777707 , version 2 (17-01-2013)
hal-00777707 , version 3 (14-11-2013)
hal-00777707 , version 1 (23-12-2014)

Identifiants

Citer

Jérôme Bolte, Stéphane Gaubert, Guillaume Vigeral. Definable Zero-Sum Stochastic Games. Mathematics of Operations Research, 2015, 40 (1), pp.171-191. ⟨10.1287/moor.2014.0666⟩. ⟨hal-00777707v3⟩
670 Consultations
414 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More