Planning in Partially Observable Domains with Fuzzy Epistemic States and Probabilistic Dynamics - Archive ouverte HAL Access content directly
Conference Papers Year : 2015

Planning in Partially Observable Domains with Fuzzy Epistemic States and Probabilistic Dynamics

Abstract

A new translation from Partially Observable MDP into Fully Observable MDP is described here. Unlike the classical translation, the resulting problem state space is finite, making MDP solvers able to solve this simplified version of the initial partially observable problem: this approach encodes agent beliefs with possibility distributions over states, leading to an MDP whose state space is a finite set of epistemic states. After a short description of the POMDP framework as well as notions of Possibility Theory, the translation is described in a formal manner with semantic arguments. Then actual computations of this transformation are detailed, in order to highly benefit from the factored structure of the initial POMDP in the final MDP size reduction and structure. Finally size reduction and tractability of the resulting MDP is illustrated on a simple POMDP problem.
Fichier principal
Vignette du fichier
drougard_15481.pdf (299.05 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01303819 , version 1 (18-04-2016)

Identifiers

Cite

Nicolas Drougard, Didier Dubois, Jean-Loup Farges, Florent Teichteil-Königsbuch. Planning in Partially Observable Domains with Fuzzy Epistemic States and Probabilistic Dynamics. 9th International Conference on Scalable Uncertainty Management (SUM 2015), Sep 2015, Quebec, Canada. pp.220-233, ⟨10.1007/978-3-319-23540-0_15⟩. ⟨hal-01303819⟩
171 View
150 Download

Altmetric

Share

Gmail Facebook X LinkedIn More