Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal of Intelligent Transportation Systems Research Année : 2023

Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection

Résumé

Intelligent traffic signal controllers, applying DQN algorithms to traffic light policy optimization, efficiently reduce traffic congestion by adjusting traffic signals to real-time traffic. Most propositions in the literature however consider that all vehicles at the intersection are detected, an unrealistic scenario. Recently, new wireless communication technologies have enabled cost-efficient detection of connected vehicles by infrastructures. With only a small fraction of the total fleet currently equipped, methods able to perform under low detection rates are desirable. In this paper, we propose a deep reinforcement Q-learning model to optimize traffic signal control at an isolated intersection, in a partially observable environment with connected vehicles. First, we present the novel DQN model within the RL framework. We introduce a new state representation for partially observable environments and a new reward function for traffic signal control, and provide a network architecture and tuned hyper-parameters. Second, we evaluate the performances of the model in numerical simulations on multiple scenarios, in two steps. At first in full detection against existing actuated controllers, then in partial detection with loss estimates for proportions of connected vehicles. Finally, from the obtained results, we define thresholds for detection rates with acceptable and optimal performance levels. The source code implementation of the model is available at: https://github.com/romainducrocq/DQN-ITSCwPD
Fichier principal
Vignette du fichier
2109.14337.pdf (767.88 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04420107 , version 1 (04-04-2024)

Identifiants

Citer

Romain Ducrocq, Nadir Farhi. Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection. International Journal of Intelligent Transportation Systems Research, 2023, 21 (1), pp.192-206. ⟨10.1007/s13177-023-00346-4⟩. ⟨hal-04420107⟩
11 Consultations
1 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More