EV-FuseMODNet: Moving object detection using the fusion of event camera and frame camera - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

EV-FuseMODNet: Moving object detection using the fusion of event camera and frame camera

Résumé

Moving object detection is a crucial task for autonomous vehicles. Indeed, dynamic objects represent higher collision risk than static ones, so the trajectories of the vehicles must be planned according to the motion forecasting of the moving participants of the scene. For the traditional framebased cameras, images can provide accumulated pixel brightness without temporal information between them. The optical flow computation is used as the inter-frame motion information. Interestingly, event-based camera can preserve the motion information by delivering the precise timestamp of each asynchronous event data, which is more suitable for the motion analysis. Also, the event-based cameras' high temporal resolution and high dynamic range allow them to work in fast motion and extreme light scenarios. In this work, we propose a new Deep Neural Network, called EV-FuseMODNet for Moving Object Detection (MOD) that captures motion and appearance information from both event-based and frame-based cameras. The proposed method has been evaluated with the extended KittiMoSeg dataset and the generated dark KITTI sequence. An overall 27.5% relative improvement on the extended KittiMoSeg dataset compared to the state-of-the-art approaches has been achieved. The code is released in https://github.com/adosum/EV-FuseMODNet.
Fichier principal
Vignette du fichier
IEEE_SOLI_2023_SUN_final.pdf (10.37 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04405932 , version 1 (19-01-2024)

Identifiants

  • HAL Id : hal-04405932 , version 1

Citer

Haixin Sun, Songming Chen, Minh-Quan Dao, Vincent Frémont. EV-FuseMODNet: Moving object detection using the fusion of event camera and frame camera. 2023 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI), Dec 2023, Singapore (SG), Singapore. ⟨hal-04405932⟩
19 Consultations
7 Téléchargements

Partager

Gmail Facebook X LinkedIn More