A Compromise Programming Approach to Multiobjective Markov Decision Processes - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal of Information Technology and Decision Making Année : 2013

A Compromise Programming Approach to Multiobjective Markov Decision Processes

Wlodzimierz Ogryczak
  • Fonction : Auteur
Patrice Perny
Paul Weng
  • Fonction : Auteur
  • PersonId : 952563

Résumé

A Markov decision process (MDP) is a general model for solving planning problems under uncertainty. It has been extended to multiobjective MDP to address multicriteria or multiagent problems in which the value of a decision must be evaluated according to several viewpoints, sometimes conflicting. Although most of the studies concentrate on the determination of the set of Pareto-optimal policies, we focus here on a more specialized problem that concerns the direct determination of policies achieving well-balanced tradeoffs. To this end, we introduce a reference point method based on the optimization of a weighted ordered weighted average (WOWA) of individual disachievements. We show that the resulting notion of optimal policy does not satisfy the Bellman principle and depends on the initial state. To overcome these difficulties, we propose a solution method based on a linear programming (LP) reformulation of the problem. Finally, we illustrate the feasibility of the proposed method on two types of planning problems under uncertainty arising in navigation of an autonomous agent and in inventory management.
Fichier non déposé

Dates et versions

hal-01170494 , version 1 (01-07-2015)

Identifiants

Citer

Wlodzimierz Ogryczak, Patrice Perny, Paul Weng. A Compromise Programming Approach to Multiobjective Markov Decision Processes. International Journal of Information Technology and Decision Making, 2013, 12 (5), pp.1021-1053. ⟨10.1142/S0219622013400075⟩. ⟨hal-01170494⟩
76 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More