Constrained deep reinforcement learning for smart load balancing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Constrained deep reinforcement learning for smart load balancing

Résumé

In this paper, we explore the use of an actor-critic architecture for Deep Reinforcement Learning (DRL) to improve load balancing beyond traditional algorithms. Some centralized Reinforcement Learning (RL) algorithms have targeted in the reward function expression the Quality of Experience (QoE) for video flows, but this requires access to clients, or the Maximum Link Utilization (MLU) for other types of flows. In our approach, we tune the actor-critic algorithm to only leverage on QoS parameters in order to load balance traffic in the network and maximize the QoE experienced by the users. This avoids having to collect observations and performance measurements from client applications, as it only focuses on network metrics that can be easily measured. We explore both centralized and distributed solutions to assess the feasibility of the proposed smart load balancing solutions. We compare them to ECMP, QoE-based reward methods, and RILNET that uses an underlying DDPG optimization approach. The proposed algorithms are shown to outperform previous approaches.
Fichier non déposé

Dates et versions

hal-03889321 , version 1 (07-12-2022)

Identifiants

Citer

Omar Houidi, Djamal Zeghlache, Victor Perrier, Pham Tran Anh Quang, Nicolas Huin, et al.. Constrained deep reinforcement learning for smart load balancing. 2022 IEEE 19th Annual Consumer Communications & Networking Conference (CCNC), Jan 2022, Las Vegas (Virtual), United States. pp.207-215, ⟨10.1109/CCNC49033.2022.9700657⟩. ⟨hal-03889321⟩
18 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More