Deep learning applied to quad-pixel plenoptic images - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Deep learning applied to quad-pixel plenoptic images

Résumé

In recent years, we have seen the development of integrated plenoptic sensors, where multiple pixels are placed under one microlens. It is mainly used by cameras and smartphones to drive the autofocus of the main lens, and it often takes the form of dual-pixels with 2 rectangular sub-pixels. We study the evolution of dual-pixels, the so-called quad-pixel sensor with 2x2 square sub-pixels under the microlens. As it is a simple light field capturing device, we investigate the computational photography abilities of such sensor. We first present our work on pixel-level simulations, then we present a model of image formation taking into account the diffraction by the microlens. Finally, we present new ways to process a quad-pixel images based on deep learning.
Fichier principal
Vignette du fichier
Quad_pixel_deep_learning.pdf (20.38 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04241632 , version 1 (13-10-2023)

Identifiants

Citer

Guillaume Chataignier, Benoit Vandame, Jérôme Vaillant. Deep learning applied to quad-pixel plenoptic images. Computational Optics 2021, Sep 2021, Online, Spain. ⟨10.1117/12.2597001⟩. ⟨hal-04241632⟩
17 Consultations
1 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More