3D reconstruction of insects: an improved multifocus stacking and an evaluation of learning-based MVS approaches - Archive ouverte HAL Access content directly
Conference Papers Year :

3D reconstruction of insects: an improved multifocus stacking and an evaluation of learning-based MVS approaches

(1) , (1) , (2) , (3) , (3) , (4)
1
2
3
4
Chang Xu
Chuong Nguyen
  • Function : Author
  • PersonId : 1114069
Fabien Casten
  • Function : Author
  • PersonId : 1114070
Benoit Maujean
  • Function : Author
  • PersonId : 1114071
Simone Gasparini

Abstract

3D reconstruction of insects from photographs is a challenging task as it requires to tackle several problems such as strong out-of-focus areas in macro-photography, thin structures (insect legs and hairs), flat-colored surfaces (insects shells), non-Lambertian (shells specularities) and even translucent surfaces (wings). In this work, we first present a new lens-based image registration technique for accurate multi-focus stacking suitable for 3D reconstruction purposes while other methods create in-focus images for viewing purpose only. We then evaluate and compare the classical Multi-View-Stereo (MVS) reconstruction pipeline for small and complex objects with recent deep learningbased reconstruction methods such as the Neural Radiance Fields (NeRF) and the Neural Sparse Voxel Fields (NSVF). We present an assessment of different sources of errors for the considered methods. The results are compared both quantitatively and qualitatively across the different methods. From this analysis we present a series of practical guidelines for addressing the common issues of the reconstruction of small objects under challenging conditions.
Fichier principal
Vignette du fichier
mainPaper.pdf (55.24 Mo) Télécharger le fichier
Vignette du fichier
supplementary.pdf (14.35 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Origin : Files produced by the author(s)

Dates and versions

hal-03386615 , version 1 (19-10-2021)
hal-03386615 , version 2 (22-10-2021)

Identifiers

Cite

Chang Xu, Jiayuan Liu, Chuong Nguyen, Fabien Casten, Benoit Maujean, et al.. 3D reconstruction of insects: an improved multifocus stacking and an evaluation of learning-based MVS approaches. International Conference on 3D Vision (3DV), Dec 2021, London, United Kingdom. ⟨10.1109/3DV53792.2021.00148⟩. ⟨hal-03386615v2⟩
213 View
33 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More