Taming denumerable Markov decision processes with decisiveness - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail (Preprint/Prepublication) Année : 2020

Taming denumerable Markov decision processes with decisiveness

Résumé

Decisiveness has proven to be an elegant concept for denumerable Markov chains: it is general enough to encompass several natural classes of denumerable Markov chains, and is a sufficient condition for simple qualitative and approximate quantitative model checking algorithms to exist. In this paper, we explore how to extend the notion of decisiveness to Markov decision processes. Compared to Markov chains, the extra non-determinism can be resolved in an adversarial or cooperative way, yielding two natural notions of decisiveness. We then explore whether these notions yield model checking procedures concerning the infimum and supremum probabilities of reachability properties.

Dates et versions

hal-04330616 , version 1 (08-12-2023)

Identifiants

Citer

Nathalie Bertrand, Patricia Bouyer, Thomas Brihaye, Paulin Fournier. Taming denumerable Markov decision processes with decisiveness. 2020. ⟨hal-04330616⟩
7 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More