Deep learning depth-intensity reconstruction from compressive TCSPC SPAD-based imaging - Archive ouverte HAL
Pré-Publication, Document De Travail (Working Paper) Année : 2023

Deep learning depth-intensity reconstruction from compressive TCSPC SPAD-based imaging

Résumé

Direct time-of-flight (D-ToF) image sensors based on Time-Correlated Single Photon Counting (TCSPC) systems face two main challenges, i.e., the limitation of spatial resolution by the amount of data to store and the accuracy of the reconstruction under high background noise. The key contribution of this paper to overcome these issues consists in the introduction of a custom pixel-wise Compressive Sensing (CS) hardware implementation in combination with a deep learning reconstruction algorithm. Besides the reduction of the pixel pitch, the CS approach limits the probability of counters overflows, enabling larger photon counts operating mode, easing the depth/intensity reconstruction process in practice. Compared to prior work on deep learning models for TCSPC data, our proposed approach achieves a similar depth-intensity reconstruction accuracy in the typical lowphoton flux mode of operation. However, when combined with the proposed CS hardware implementation compatible with high photon counting, our solution outperforms the most advanced SPAD sensing strategies as well as the best-in-class remote processing, both in terms of intensity-depth reconstruction performance and pixel pitch reduction.
Fichier principal
Vignette du fichier
arxiv_CS_attention_TCSPC.pdf (2.45 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04192408 , version 1 (31-08-2023)

Identifiants

  • HAL Id : hal-04192408 , version 1

Citer

Valentin Poisson, William Guicquero, Gilles Sicard. Deep learning depth-intensity reconstruction from compressive TCSPC SPAD-based imaging. 2023. ⟨hal-04192408⟩
104 Consultations
141 Téléchargements

Partager

More