Policy-Gradient-Based Reinforcement Learning for Computing Resources Allocation in O-RAN - Archive ouverte HAL Access content directly
Conference Papers Year : 2022

Policy-Gradient-Based Reinforcement Learning for Computing Resources Allocation in O-RAN

Mahdi Sharara
Turgay Pamuklu
  • Function : Author
  • PersonId : 1168494
Sahar Hoteit
Véronique Vèque

Abstract

Open Radio Access Network (O-RAN) is a novel architecture aiming to disaggregate the network components to reduce capital and operational costs and open the interfaces to ensure interoperability. In this work, we consider the problem of allocating computing resources to process the data of enhanced Mobile BroadBand (eMBB) users and Ultra-Reliable Low-Latency (URLLC) Users. Supposing the processing of users' frames from different base stations is done in a shared O-Cloud, we model the computing resources allocation problem as an Integer Linear Programming (ILP) problem that aims at fairly allocating computing resources to eMBB and URLLC users and optimizing the QoS of URLLC users without neglecting eMBB users. Due to the high complexity of solving an ILP problem, we model the problem using Reinforcement Learning (RL). Our results demonstrate the ability of our RL-based solution to perform close to the ILP solver while having much lower computational complexity. For a different number of Open Radio Units (O-RUs), the objective value of the RL agent does not deviate from the ILP objective by more than 6%.
Fichier principal
Vignette du fichier
Policy_Gradient_Based_RL_for_Computing_Resources_Allocation_in_O_RAN (5).pdf (800.77 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03791024 , version 1 (28-09-2022)

Identifiers

Cite

Mahdi Sharara, Turgay Pamuklu, Sahar Hoteit, Véronique Vèque, Melike Erol-Kantarci. Policy-Gradient-Based Reinforcement Learning for Computing Resources Allocation in O-RAN. 2022 IEEE 11th International Conference on Cloud Networking (CloudNet), Nov 2022, Paris, France. ⟨10.1109/cloudnet55617.2022.9978863⟩. ⟨hal-03791024⟩
170 View
197 Download

Altmetric

Share

Gmail Facebook X LinkedIn More