Joint Chance-Constrained Markov Decision Processes - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Annals of Operations Research Année : 2023

Joint Chance-Constrained Markov Decision Processes

Résumé

We consider a finite state-action uncertain constrained Markov decision process under discounted and average cost criteria. The running costs are defined by random variables and the transition probabilities are known. The uncertainties present in the objective function and the constraints are modelled using chance constraints. We assume that the random cost vectors follow multivariate elliptically symmetric distributions and dependence among the random constraints is driven by a Gumbel-Hougaard copula. We propose two second order cone programming problems whose optimal values give lower and upper bounds of the optimal value of the uncertain constrained Markov decision process. As an application, we study a stochastic version of a service and admission control problem in a queueing system. The proposed approximation methods are illustrated on randomly generated instances of queueing control problem as well as on well known class of Markov decision problems known as Garnets.
Fichier principal
Vignette du fichier
chance_constrained_MDP.pdf (550.57 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04375382 , version 1 (05-01-2024)

Identifiants

Citer

V Varagapriya, Vikas Vikram Singh, Abdel Lisser. Joint Chance-Constrained Markov Decision Processes. Annals of Operations Research, 2023, 322, pp.1013-1035. ⟨10.1007/s10479-022-05025-3⟩. ⟨hal-04375382⟩
11 Consultations
8 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More