Reducing fuel consumption in platooning systems through reinforcement learning - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Reducing fuel consumption in platooning systems through reinforcement learning

Rafael F Cunha
  • Fonction : Auteur
  • PersonId : 1215784
Tiago R Goncalves
Vineeth Varma
Ming Cao
  • Fonction : Auteur
  • PersonId : 1215785

Résumé

Fuel efficiency in platooning systems is a central topic of interest because of its significant economic and environmental impact on the transportation industry. In platoon systems, Adaptive Cruise Control (ACC) is widely adopted because it can guarantee string stability while requiring only radar or lidar measurements. A key parameter in ACC is the desired time gap between the platoon's neighboring vehicles. A small time gap results in a short inter-vehicular distance, which is fuel efficient when the vehicles are moving at constant speeds due to air drag reductions. On the other hand, when the vehicles accelerate and brake a lot, a bigger time gap is more fuel efficient. This motivates us to find a policy that minimizes fuel consumption by conveniently switching between two desired time gap parameters. Thus, one can interpret this formulation as a dynamic system controlled by a switching ACC, and the learning problem reduces to finding a switching rule that is fuel efficient. We apply a Reinforcement Learning (RL) algorithm to find a time switching policy between two desired time gap parameters of an ACC controller to reach our goal. We adopt the proximal policy optimization (PPO) algorithm to learn the appropriate transient shift times that minimize the platoon's fuel consumption when it faces stochastic traffic conditions. Numerical simulations show that the PPO algorithm outperforms both static time gap ACC and a threshold-based switching control in terms of the average fuel efficiency.
Fichier principal
Vignette du fichier
DRL_approach_to_improve_efficiency_in_platooning_systems.pdf (283.48 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03940360 , version 1 (16-01-2023)

Identifiants

Citer

Rafael F Cunha, Tiago R Goncalves, Vineeth Varma, Salah E Elayoubi, Ming Cao. Reducing fuel consumption in platooning systems through reinforcement learning. 6th IFAC Conference on Intelligent Control and Automation Sciences ICONS 2022, Jul 2022, Cluj-Napoca, Romania. pp.99-104, ⟨10.1016/j.ifacol.2022.07.615⟩. ⟨hal-03940360⟩
59 Consultations
41 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More