Multi-View Reconstruction using Signed Ray Distance Functions (SRDF) - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Multi-View Reconstruction using Signed Ray Distance Functions (SRDF)

Résumé

In this paper, we investigate a new optimization framework for multi-view 3D shape reconstructions. Recent differentiable rendering approaches have provided breakthrough performances with implicit shape representations though they can still lack precision in the estimated geometries. On the other hand multi-view stereo methods can yield pixel wise geometric accuracy with local depth predictions along viewing rays. Our approach bridges the gap between the two strategies with a novel volumetric shape representation that is implicit but parameterized with pixel depths to better materialize the shape surface with consistent signed distances along viewing rays. The approach retains pixel-accuracy while benefiting from volumetric integration in the optimization. To this aim, depths are optimized by evaluating, at each 3D location within the volumetric discretization, the agreement between the depth prediction consistency and the photometric consistency for the corresponding pixels. The optimization is agnostic to the associated photo-consistency term which can vary from a median-based baseline to more elaborate criteria~\eg learned functions. Our experiments demonstrate the benefit of the volumetric integration with depth predictions. They also show that our approach outperforms existing approaches over standard 3D benchmarks with better geometry estimations.
Fichier principal
Vignette du fichier
CVPR2023-9.pdf (14.61 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03766943 , version 1 (01-09-2022)
hal-03766943 , version 2 (10-03-2023)

Identifiants

Citer

Pierre Zins, Yuanlu Xu, Edmond Boyer, Stefanie Wuhrer, Tony Tung. Multi-View Reconstruction using Signed Ray Distance Functions (SRDF). CVPR 2023 - IEEE/CVF Conference on Computer Vision and Pattern Recognition, Jun 2023, Vancouver, Canada. pp.1-11. ⟨hal-03766943v2⟩
257 Consultations
92 Téléchargements

Altmetric

Partager

More