Optimization of hybrid stochastic differential systems in communications networks - Archive ouverte HAL Access content directly
Journal Articles Nonlinear Analysis: Hybrid Systems Year : 2015

Optimization of hybrid stochastic differential systems in communications networks

(1)
1
Hana Baili

Abstract

This paper addresses issues from applied stochastic analysis for modeling and solving control problems in communications networks. We consider the problem of optimal scheduling in a wireless system with time varying traffic. The system is handled by a single base station transmitting over time varying channels. This may be the case in practice for a hybrid TDMA–CDMA (Time Division Multiple Access–Code Division Multiple Access) system. Heavy traffic approximation for the physical system yields a problem of optimal control in a constrained hybrid stochastic differential system. Here constrained means bounded or reflected in the KK-dimensional positive orthant. In this work we establish a closed form solution for the nascent optimal control problem. The aim is to find a control which minimizes the expected total delay for the users. The control is constrained to satisfy some inequalities. Hence it seems natural that the cost function involve a penalty term for breaking these inequalities. We study this control problem by a dynamic programming approach and we are led to the resolution of a Hamilton–Jacobi–Bellman (HJB) equation in the finite dimensional space View the MathML sourceR+K. While optimizing it turns out that the optimum falls inside the class of feedback controls. Hence our method consists in finding a smooth solution of Bellman’s equation and consequently getting a unique solution for the closed loop. Here a separation of variables enables us to construct an explicit C2C2 solution of the HJB equation so that existence of a unique optimal control is proven. Further stochastic analysis of the hybrid stochastic differential system under the optimal control is provided: the Fokker–Planck equation for the distribution density of the state.
Not file

Dates and versions

hal-01118424 , version 1 (19-02-2015)

Identifiers

Cite

Hana Baili. Optimization of hybrid stochastic differential systems in communications networks. Nonlinear Analysis: Hybrid Systems, 2015, 17 (3), pp.25-43. ⟨10.1016/j.nahs.2015.01.003⟩. ⟨hal-01118424⟩
92 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More