Implementing Handheld Burst Super-resolution - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Image Processing On Line Année : 2023

Implementing Handheld Burst Super-resolution

Résumé

Nowadays, smartphone cameras capture bursts of raw photographs whenever the trigger is pressed. These photos are then fused to produce a single picture with higher quality. This paper details the implementation of the method "Handheld Multi-Frame Super-Resolution algorithm" by Wronski et al. (used in the Google Pixel 3 camera), which performs simultaneously multiimage super-resolution demosaicking and denoising from a burst of images. Hand tremors during exposure cause subpixel motions, which combined with the Bayer color filter array of the sensor results in a collection of aliased and shifted raw photographs of the same scene. The algorithm efficiently aligns and fuses these signals into a single high-resolution one by leveraging the aliasing to reconstruct the high-frequencies of the signal up to the Nyquist rate of the sensor. This approach yields digitally zoomed images up to a factor of 2, which is the limit naturally set by the sensor pixel integration. We present an in-depth description of this algorithm, along with numerous implementation details we have found to reproduce the results of the original paper, whose code is not publicly available. Source Code The source code for reproducing the results presented in this paper is available in the first author's GitHub page 1. It is implemented in Python with Numba support for fast GPU-based computations.
Fichier principal
Vignette du fichier
IPOL_Handheld (1).pdf (4.96 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04136450 , version 1 (22-06-2023)

Identifiants

Citer

Jamy Lafenetre, Gabriele Facciolo, Thomas Eboli. Implementing Handheld Burst Super-resolution. Image Processing On Line, 2023, 13, pp.227-257. ⟨10.5201/ipol.2023.460⟩. ⟨hal-04136450⟩
114 Consultations
60 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More