Towards Safe Model-Free Building Energy Management using Masked Reinforcement Learning - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Towards Safe Model-Free Building Energy Management using Masked Reinforcement Learning

Résumé

Autonomous control of building energy resources including HVAC and battery storage systems has the potential to optimize operations and achieve objectives such as cost minimization. Existing approaches either require an explicit mathematical model of the building, or resort to simple rule-based controls (RBC) which may be sub-optimal. Model-free reinforcement learning (RL) is a promising method to overcome these limitations - however, it often requires a large number of interactions with the real environment before learning a functional policy. In this work, we investigate ’Action Masking’, a technique to improve the learning efficiency of RL algorithms while respecting safety rules during the learning phase. Our solution achieves a cost reduction of 6% compared to a baseline rule-based controller, and also outperforms a popular transfer learning strategy. This suggests that model-free RL approaches are feasible and practical for problems in this domain.
Fichier principal
Vignette du fichier
2023_ISGT_Rigo-Mariani_Kumar.pdf (633.56 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04431424 , version 1 (05-02-2024)

Identifiants

Citer

Sharath Ram Kumar, Rémy Rigo-Mariani, Benoit Delinchant, Arvind Easwaran. Towards Safe Model-Free Building Energy Management using Masked Reinforcement Learning. 2023 IEEE PES Innovative Smart Grid Technologies Europe (ISGT EUROPE), Oct 2023, Grenoble, France. pp.1-5, ⟨10.1109/ISGTEUROPE56780.2023.10407781⟩. ⟨hal-04431424⟩
107 Consultations
68 Téléchargements

Altmetric

Partager

More