Real-Time 3D Multi-Object Detection and Localization Based on Deep Learning for Road and Railway Smart Mobility - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Journal of Imaging Année : 2021

Real-Time 3D Multi-Object Detection and Localization Based on Deep Learning for Road and Railway Smart Mobility

Résumé

For smart mobility, autonomous vehicles, and advanced driver-assistance systems (ADASs), perception of the environment is an important task in scene analysis and understanding. Better perception of the environment allows for enhanced decision making, which, in turn, enables very high-precision actions. To this end, we introduce in this work a new real-time deep learning approach for 3D multi-object detection for smart mobility not only on roads, but also on railways. To obtain the 3D bounding boxes of the objects, we modified a proven real-time 2D detector, YOLOv3, to predict 3D object localization, object dimensions, and object orientation. Our method has been evaluated on KITTI’s road dataset as well as on our own hybrid virtual road/rail dataset acquired from the video game Grand Theft Auto (GTA) V. The evaluation of our method on these two datasets shows good accuracy, but more importantly that it can be used in real-time conditions, in road and rail traffic environments. Through our experimental results, we also show the importance of the accuracy of prediction of the regions of interest (RoIs) used in the estimation of 3D bounding box parameters
Fichier principal
Vignette du fichier
jimaging-07-00145(2).pdf (9.79 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03324039 , version 1 (23-08-2021)

Identifiants

Citer

Antoine Mauri, Redouane Khemmar, Benoit Decoux, Madjid Haddad, Rémi Boutteau. Real-Time 3D Multi-Object Detection and Localization Based on Deep Learning for Road and Railway Smart Mobility. Journal of Imaging, 2021, 7 (8), pp.145. ⟨10.3390/jimaging7080145⟩. ⟨hal-03324039⟩
134 Consultations
82 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More