Monkey business: reinforcement learning meets neighborhood search for virtual network embedding. - Archive ouverte HAL Access content directly
Journal Articles Computer Networks Year : 2022

Monkey business: reinforcement learning meets neighborhood search for virtual network embedding.

Monkey Business : L'apprentissage par renforcement rencontre la recherche de quartier pour l'intégration de réseaux virtuels

Abstract

In this article, we consider the Virtual Network Embedding (VNE) problem for 5G networks slicing. This problem requires to allocate multiple Virtual Networks (VN) on a substrate virtualized physical network while maximizing among others, resource utilization, maximum number of placed VNs and network operator’s benefit. We solve the online version of the problem where slices arrive over time. Inspired by the Nested Rollout Policy Adaptation (NRPA) algorithm, a variant of the well known Monte Carlo Tree Search (MCTS) that learns how to perform good simulations over time, we propose a new algorithm that we call Neighborhood Enhanced Policy Adaptation (NEPA). The key feature of our algorithm is to observe NRPA cannot exploit knowledge acquired in one branch of the state tree for another one which starts differently. NEPA learns by combining NRPA with Neighborhood Search in a frugal manner which improves only promising solutions while keeping the running time low. We call this technique a monkey business because it comes down to jumping from one interesting branch to the other, similar to how monkeys jump from tree to tree instead of going down everytime. NEPA achieves better results in terms of acceptance ratio and revenue-to-cost ratio compared to other state-of-the-art algorithms, both on real and synthetic topologies.

Dates and versions

hal-03876945 , version 1 (29-11-2022)

Identifiers

Cite

Maxime Elkael, Massinissa Ait Aba, Andrea Araldo, Hind Castel-Taleb, Badii Jouaber. Monkey business: reinforcement learning meets neighborhood search for virtual network embedding.. Computer Networks, 2022, 216 (109204), ⟨10.1016/j.comnet.2022.109204⟩. ⟨hal-03876945⟩
29 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More