Regularizing Neural Radiance Fields from Sparse Rgb-D Inputs - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Regularizing Neural Radiance Fields from Sparse Rgb-D Inputs

Résumé

This paper aims to improve neural radiance fields (NeRF) from sparse inputs. NeRF achieves photo-realistic renderings when given dense inputs, while its’ performance drops dramatically with the decrease of training views’ number. Our insight is that the standard volumetric rendering of NeRF is prone to over-fitting due to the lack of overall geometry and local neighborhood information from limited inputs. To address this issue, we propose a global sampling strategy with a geometry regularization utilizing warped images as augmented pseudo-views to encourage geometry consistency across multi-views. In addition, we introduce a local patch sampling scheme with a patch-based regularization for appearance consistency. Furthermore, our method exploits depth information for explicit geometry regularization. The proposed approach outperforms existing baselines on real benchmarks DTU datasets from sparse inputs and achieves the state of art results.
Fichier non déposé

Dates et versions

hal-04357757 , version 1 (21-12-2023)

Identifiants

Citer

Qian Li, Franck Multon, Adnane Boukhayma. Regularizing Neural Radiance Fields from Sparse Rgb-D Inputs. 2023 IEEE International Conference on Image Processing (ICIP), Oct 2023, Kuala Lumpur, Malaysia. ⟨10.1109/icip49359.2023.10222706⟩. ⟨hal-04357757⟩
9 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More