Using event cameras for imaging through atmospheric turbulence - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Using event cameras for imaging through atmospheric turbulence

Résumé

Long range horizontal path imaging through atmospheric turbulence is hampered by spatiotemporally randomly varying shifting and blurring of scene points in recorded imagery. Typical mitigation strategies employ software algorithms that combine optical flow to estimate and reduce tip/tilt aberrations with lucky patch identification and data fusion to filter higher order aberrations. In practice, accurate and fast optical flow estimation in turbulence faces is highly challenging. Here we investigate if these challenges can be overcome by using a neuromorphic camera. These sensors measure logarithmic changes in scene radiance in each pixel instead of the radiance itself. The changes are thresholded to produce a stream of events, which enables an ultrafast time resolution on the order of microseconds and enables efficient optical flow estimation at very high frame rates. Here we report on our initial experiments, where we have used a neuromorphic camera to image through turbulence in a controlled indoor setting. We analyze how the sensor responds to the turbulence induced apparent scene motion and propose an algorithm for computing high resolution images of the scene from the event stream in combination with intensity frames. Our initial results do not show a statistical relation between event counts and lucky patches. The image reconstruction based on the event stream did show promising improvements in output image sharpness and stability compared to the raw image stream, with many opportunities for further improvement.
Fichier principal
Vignette du fichier
coat_boehrer.pdf (1.16 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03146226 , version 1 (18-02-2021)

Licence

Paternité - Pas d'utilisation commerciale

Identifiants

Citer

Nicolas Boehrer, Robert Nieuwenhuizen, Judith Dijk. Using event cameras for imaging through atmospheric turbulence. COAT-2019 - workshop (Communications and Observations through Atmospheric Turbulence: characterization and mitigation), ONERA, Dec 2019, Châtillon, France. ⟨10.34693/COAT2019-S4-005⟩. ⟨hal-03146226⟩

Collections

COAT2019
138 Consultations
257 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More