An enhanced reinforcement learning approach for dynamic placement of virtual network functions - Archive ouverte HAL
Communication Dans Un Congrès Année : 2020

An enhanced reinforcement learning approach for dynamic placement of virtual network functions

Résumé

This paper addresses Virtualized Network Function Forwarding Graph (VNF-FG) embedding with the objective of realizing long term reward compared to placement algorithms that aim at instantaneous optimal placement. The long term reward is obtained using Reinforcement Learning (RL), following a Markov Decision Process (MDP) model, enhanced through the injection of expert knowledge in the learning process. A comparison with an Integer Linear Programming (ILP) approach, a reduced candidate set (R-ILP), and an algorithm that treats the requests in batch reveals the potential improvements using the RL approach. The instantaneous and short term reward solutions are efficient only in finding instant solutions as they make decisions only on current infrastructure status for a given request at a time or eventually a batch of requests. They are efficient only for present conditions without anticipating future requests. RL possesses instead the learning and anticipation capabilities lacking in instantaneous and snapshot optimizations. A Reinforcement Learning based approach, called EQL (Enhanced Q-Learning), aiming at balancing the load on hosting infrastructures is proposed to achieve the desired longer term reward. EQL employs RL to learn the network and control it based on the usage patterns of the physical resources. Results from extensive simulations, based on realistic and large scale topologies, report the superior performance of EQL in terms of acceptance rate, quality, scalability and achieved gains.
Fichier non déposé

Dates et versions

hal-03973124 , version 1 (03-02-2023)

Identifiants

Citer

Omar Houidi, Oussama Soualah, Wajdi Louati, Djamal Zeghlache. An enhanced reinforcement learning approach for dynamic placement of virtual network functions. IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications(PIMRC), Aug 2020, London, United Kingdom. ⟨10.1109/PIMRC48278.2020.9217250⟩. ⟨hal-03973124⟩
21 Consultations
0 Téléchargements

Altmetric

Partager

More