Asymptotic Control for a Class of Piecewise Deterministic Markov Processes Associated to Temperate Viruses - Archive ouverte HAL Access content directly
Journal Articles SIAM Journal on Control and Optimization Year : 2015

Asymptotic Control for a Class of Piecewise Deterministic Markov Processes Associated to Temperate Viruses

Dan Goreac
  • Function : Author
PS

Abstract

We aim at characterizing the asymptotic behavior of value functions in the control of piece-wise deterministic Markov processes (PDMP) of switch type under nonexpansive assumptions. For a particular class of processes inspired by temperate viruses, we show that uniform limits of discounted problems as the discount decreases to zero and time-averaged problems as the time horizon increases to infinity exist and coincide. The arguments allow the limit value to depend on initial configuration of the system and do not require dissipative properties on the dynamics. The approach strongly relies on viscosity techniques, linear programming arguments and coupling via random measures associated to PDMP. As an intermediate step in our approach, we present the approximation of discounted value functions when using piecewise constant (in time) open-loop policies.
Fichier principal
Vignette du fichier
Goreac_AsymptoticValuesPDMP_Rev1.pdf (317.41 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01089528 , version 1 (02-12-2014)
hal-01089528 , version 2 (05-12-2014)
hal-01089528 , version 3 (06-03-2015)
hal-01089528 , version 4 (27-05-2015)

Identifiers

Cite

Dan Goreac. Asymptotic Control for a Class of Piecewise Deterministic Markov Processes Associated to Temperate Viruses. SIAM Journal on Control and Optimization, 2015, 53 (4), pp.1860-1891. ⟨10.1137/140998913⟩. ⟨hal-01089528v4⟩
145 View
163 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More