Deciding the Value 1 Problem for Reachability in 1-Clock Decision Stochastic Timed Automata - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2014

Deciding the Value 1 Problem for Reachability in 1-Clock Decision Stochastic Timed Automata

Résumé

We consider reachability objectives on an extension of stochastic timed automata (STA) with nondeterminism. Decision stochastic timed automata (DSTA) are Markov decision processes based on timed automata where delays are chosen randomly and choices between enabled edges are nondeterministic. Given a reachability objective, the value 1 problem asks whether a target can be reached with probability arbitrary close to 1. Simple examples show that the value can be 1 and yet no strategy ensures reaching the target with probability 1. In this paper, we prove that, the value 1 problem is decidable for single clock DSTA by non-trivial reduction to a simple almost-sure reachability problem on a finite Markov decision process. The ε-optimal strategies are involved: the precise probability distributions, even if they do not change the winning nature of a state, impact the timings at which ε-optimal strategies must change their decisions, and more surprisingly these timings cannot be chosen uniformly over the set of regions.
Fichier principal
Vignette du fichier
paper44.pdf (389 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01088113 , version 1 (27-11-2014)

Identifiants

Citer

Nathalie Bertrand, Thomas Brihaye, Blaise Genest. Deciding the Value 1 Problem for Reachability in 1-Clock Decision Stochastic Timed Automata. Quantitative Evaluation of Systems (QEST'14), Sep 2014, Florence, Italy. pp.313 - 328, ⟨10.1007/978-3-319-10696-0_25⟩. ⟨hal-01088113⟩
222 Consultations
143 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More