PRISMA: A Packet Routing Simulator for Multi-Agent Reinforcement Learning - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

PRISMA: A Packet Routing Simulator for Multi-Agent Reinforcement Learning

Résumé

In this paper, we present PRISMA: Packet Routing Simulator for Multi-Agent Reinforcement Learning. To the best of our knowledge, this is the first tool specifically conceived to develop and test Reinforcement Learning (RL) algorithms for the Distributed Packet Routing (DPR) problem. In this problem, where a communication node selects the outgoing port to forward a packet using local information, distance-vector routing protocol (e.g., RIP) are traditionally applied. However, when network status changes very dynamically, is uncertain, or is partially hidden (e.g., wireless ad hoc networks or wired multi-domain networks), RL is an alternate solution to discover routing policies better fitted to these cases. Unfortunately, no RL tools have been developed to tackle the DPR problem, forcing the researchers to implement their own simplified RL simulation environments, complicating reproducibility and reducing realism. To overcome these issues, we present PRISMA, which offers to the community a standardized framework where: (i) communication process is realistically modelled (thanks to ns3); (ii) distributed nature is explicitly considered (nodes are implemented as separated threads); (iii) and, RL proposals can be easily developed (thanks to a modular code design and real-time training visualization interfaces) and fairly compared them.
Fichier principal
Vignette du fichier
2022087215 (1).pdf (555.9 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03709948 , version 1 (12-10-2022)

Identifiants

Citer

Redha A. Alliche, Tiago da Silva Barros, Ramon Aparicio-Pardo, Lucile Sassatelli. PRISMA: A Packet Routing Simulator for Multi-Agent Reinforcement Learning. 4th Intl Workshop on Network Intelligence collocated with IFIP Networking 2022, Jun 2022, Catania, Italy. ⟨10.23919/IFIPNetworking55013.2022.9829797⟩. ⟨hal-03709948⟩
112 Consultations
260 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More