Resilient deep reinforcement learning architecture for task offloading in autonomous IoT systems - LAAS-Réseaux et Communications Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Resilient deep reinforcement learning architecture for task offloading in autonomous IoT systems

Résumé

Autonomous IoT systems require the development of good automation algorithms capable of handling a huge number of IoT devices such as in smart cities. Deep Reinforcement Learning (DRL) is a powerful automation technique that can be used in massive systems thanks to its ability to deal with big state spaces. Moreover, it adapts quickly to changes in the system by reinforcement learning, making the automation algorithm very flexible. However, using DRL relies generally on centralized agent architecture making it more exposed to communication failures. In this paper, we propose a distributed architecture to solve the task offloading problem in autonomous IoT systems where learning is achieved in a master agent while decision making is delegated to IoT devices. This architecture is more resilient as decisions are made locally and interactions between IoT devices and the master agent are less frequent and not blocking. We tested this architecture in the ns3-gym environment and our results show very good resilience of this architecture.
Fichier principal
Vignette du fichier
DRL-AIoTS.pdf (384.07 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03763258 , version 1 (29-08-2022)

Identifiants

Citer

Abdel Kader Chabi Sika Boni, Youssef Hablatou, Hassan Hassan, Khalil Drira. Resilient deep reinforcement learning architecture for task offloading in autonomous IoT systems. The 12th International Conference on the Internet of Things (IoT 2022), Nov 2022, Delft, Netherlands. ⟨10.1145/3567445.3567454⟩. ⟨hal-03763258⟩
97 Consultations
48 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More