Behavioural Cloning based RL Agents for District Energy Management - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Behavioural Cloning based RL Agents for District Energy Management

Résumé

In this work, we discuss a method to incorporate domain knowledge into a Reinforcement Learning (RL) environment through the process of behavioral cloning, in the context of a district energy management system. Prior knowledge, encoded into heuristic rule-based programs, is used to initialize a policy network for an RL agent, after which an RL algorithm is used to improve on this by optimizing against a reward function. The key ideas are implemented in the CityLearn framework, where the resulting controller is used to manage the electrical energy storage for 5 buildings in a district. We demonstrate that the resulting agents offer measurable performance gains compared to existing baselines, offering a 3.8% improvement over the underlying rule-based controller, and a 20% improvement over a pure RL based controller. We also illustrate the possibility of using imitation learning to develop agents with desirable characteristics without explicit reward shaping.
Fichier principal
Vignette du fichier
2022 - RLEM.pdf (553.58 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03851408 , version 1 (14-11-2022)

Identifiants

Citer

Sharath Ram Kumar, Arvind Easwaran, Benoit Delinchant, Rémy Rigo-Mariani. Behavioural Cloning based RL Agents for District Energy Management. ACM SIGEnergy Workshop on Reinforcement Learning for Energy Management in Buildings & Cities (RLEM), Nov 2022, Boston, United States. ⟨10.1145/3563357.3566165⟩. ⟨hal-03851408⟩
57 Consultations
71 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More