Resource allocation for multi-source multi-relay wireless networks: A multi-armed bandit approach - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2021

Resource allocation for multi-source multi-relay wireless networks: A multi-armed bandit approach

Ali Al Khansa
  • Fonction : Auteur
Raphael Visoz
  • Fonction : Auteur
Yezekael Hayel

Résumé

In this paper, we consider the problem of link adaptation (rate allocation) of Orthogonal Multiple Access Multiple Relay Channel (OMAMRC) using the Multi-Armed Bandit (MAB) online learning framework. The cooperative system is composed of a transmission phase where sources transmit in a round robin manner, and a retransmission phase where a scheduled node sends redundancies. We assume that we have no knowledge of the Channel State Information (CSI) nor of the Channel Distributed Information (CDI). Accordingly, rate allocation must be learned online following a sequential learning algorithm. We adapt to one variant of the MAB framework algorithms, the Upper Confidence Bound (UCB) family, and specifically the UCB1 algorithm. The UCB1 algorithm achieves a logarithmic regret uniformly over time, without any preliminary knowledge about the reward distributions. Due to the exponential growth of the number of arms, following the multiple sources included in the rate allocation, the UCB1 algorithm features a complexity problem. Thus, we propose a sequential UCB1 (SUCB1) algorithm which solves the complexity issue, and outperforms the UCB1 algorithm.
Fichier non déposé

Dates et versions

hal-03507430 , version 1 (03-01-2022)

Identifiants

Citer

Ali Al Khansa, Raphael Visoz, Yezekael Hayel, Samson Lasaulce. Resource allocation for multi-source multi-relay wireless networks: A multi-armed bandit approach. Ubiquitous Networking, 12845, Springer International Publishing, pp.62-75, 2021, Lecture Notes in Computer Science, ⟨10.1007/978-3-030-86356-2_6⟩. ⟨hal-03507430⟩
56 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More