Transfer Restless Multi-Armed Bandit Policy for Energy Efficient Heterogeneous Cellular Network - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue EURASIP Journal on Advances in Signal Processing Année : 2019

Transfer Restless Multi-Armed Bandit Policy for Energy Efficient Heterogeneous Cellular Network

Résumé

This paper proposes a learning policy to improve the energy efficiency (EE) of heterogeneous cellular networks. The combination of active and inactive base stations (BS) that allows for maximizing EE is identified as a combinatorial learning problem and requires high computational complexity as well as a large signaling overhead. This paper aims at presenting a learning policy that dynamically switches a BS to ON or OFF status in order to follow the traffic load variation during the day. The network traffic load is represented as a Markov decision process, and we propose a modified upper confidence bound algorithm based on restless Markov multi-armed bandit framework for the BS switching operation. Moreover, to cope with initial reward loss and to speed up the convergence of the learning algorithm, the transfer learning concept is adapted to our algorithm in order to benefit from the transferred knowledge observed in historical periods from the same region. Moreover, based on our previous work, a convergence theorem is provided for the proposed policy. Extensive simulations demonstrate that the proposed algorithms follow the traffic load variation during the day and contribute to a performance jump-start in EE improvement under various practical traffic load profile. It also demonstrates that proposed schemes can significantly reduce the total energy consumption of cellular network, e.g. up to 70% potential energy savings based on a real traffic profile.
Fichier principal
Vignette du fichier
eurasip_eem_ucb_revision2.pdf (1.42 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02307007 , version 1 (07-10-2019)

Identifiants

Citer

Navikkumar Modi, Philippe Mary, Christophe Moy. Transfer Restless Multi-Armed Bandit Policy for Energy Efficient Heterogeneous Cellular Network. EURASIP Journal on Advances in Signal Processing, 2019, 46 (1), ⟨10.1186/s13634-019-0637-1⟩. ⟨hal-02307007⟩
56 Consultations
57 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More