Object Tracking with a fusion of Event-based Camera and Frame-based Camera - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

Object Tracking with a fusion of Event-based Camera and Frame-based Camera

Résumé

The framed-based camera is commonly used for object tracking tasks. However, under poor light conditions, the frame camera cannot work properly and provide stable detection for the tracking system. Also, it has motion blur when the object is moving fast. Compared to the frame-based camera, the event camera has a higher temporal resolution and dynamic range. The event data is transmitted immediately when the brightness of each pixel changes. The higher temporal resolution helps the event camera avoid the motion blur and provide more precise temporal information. Moreover, the higher dynamic range allows the event camera to work in extreme light conditions, such as evening, raining, and strong sunshine environments. In all, those advantages make the event cameras an applicable complementary sensor to the frame cameras. In this paper, several optical flow algorithms for the event data are tested. Then, a clustering algorithm is proposed to generate the detection and hybrid it with the detection from frame images. At last, the PMBM filter is used to realize object tracking and test it on our self-recorded dataset with the DAVIS346 and several publicly available datasets.
Fichier principal
Vignette du fichier
IntelliSys2022_Haixin_SUN_.pdf (8.74 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03771339 , version 1 (07-09-2022)

Identifiants

  • HAL Id : hal-03771339 , version 1

Citer

Haixin Sun, Vincent Frémont. Object Tracking with a fusion of Event-based Camera and Frame-based Camera. IntelliSys 2022, Sep 2022, Amsterdam, Netherlands. ⟨hal-03771339⟩
122 Consultations
326 Téléchargements

Partager

More