Deep Light Field Acquisition Using Learned Coded Mask Distributions for Color Filter Array Sensors - Archive ouverte HAL
Article Dans Une Revue IEEE Transactions on Computational Imaging Année : 2021

Deep Light Field Acquisition Using Learned Coded Mask Distributions for Color Filter Array Sensors

Résumé

Compressive light field photography enables light field acquisition using a single sensor by utilizing a color coded mask. This approach is very cost effective since consumer-level digital cameras can be turned into light field cameras by simply placing a coded mask between the sensor and the aperture plane. This paper describes a deep learning architecture for compressive light field acquisition using a color coded mask and a sensor with Color Filter Array (CFA). Unlike previous methods where a fixed mask pattern is used, our deep network learns the optimal distribution of the color coded mask pixels. The proposed solution enables end-to-end learning of the color-coded mask distribution and the reconstruction network, taking into account the sensor CFA. Consequently, the resulting network can efficiently perform joint demosaicing and light field reconstruction of images acquired with color-coded mask and a CFA sensor. Compared to previous methods based on deep learning with monochrome sensors, as well as traditional compressive sensing approaches using CFA sensors, we obtain superior color reconstruction of the light fields.
Fichier principal
Vignette du fichier
Deep_Light_Field_Acquisition_Using_Learned_Coded_Mask_Distributions_for_Color_Filter_Array_Sensors-1.pdf (4.81 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03203347 , version 1 (20-04-2021)

Identifiants

Citer

Guillaume Le Guludec, Ehsan Miandji, Christine Guillemot. Deep Light Field Acquisition Using Learned Coded Mask Distributions for Color Filter Array Sensors. IEEE Transactions on Computational Imaging, 2021, 7, pp.475 - 488. ⟨10.1109/TCI.2021.3077131⟩. ⟨hal-03203347⟩
157 Consultations
190 Téléchargements

Altmetric

Partager

More