Mobile photometric stereo with keypoint-based SLAM for dense 3D reconstruction - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Mobile photometric stereo with keypoint-based SLAM for dense 3D reconstruction

Remy Maxence
  • Fonction : Auteur
  • PersonId : 1072789
Hideaki Uchiyama
  • Fonction : Auteur
Diego Thomas
  • Fonction : Auteur
  • PersonId : 1072790
Vincent Nozick

Résumé

The standard photometric stereo is a technique to densely reconstruct objects surfaces using light variation under the assumption of a static camera with a moving light source. In this work, we use photometric stereo to reconstruct dense 3D scenes while moving the camera and the light altogether. In such non-static case, camera poses as well as correspondences between pixels of each frame to apply photometric stereo are required. ORB-SLAM is a technique that can be used to estimate camera poses. To retrieve correspondences, our idea is to start from a sparse 3D mesh obtained with ORB SLAM and then densify the mesh by a plane sweep method using a multi-view photometric consistency. By combining ORB-SLAM and photometric stereo, it is possible to reconstruct dense 3D scenes with a off-the-shelf smartphone and its embedded torchlight. Note that SLAM systems usually struggle with textureless object, which is effectively compensated by the photometric stereo in our method. Experiments are conducted to show that our proposed method gives better results than SLAM alone or COLMAP, especially for partially textureless surfaces.
Fichier principal
Vignette du fichier
2019_3DV_Maxence_camera_ready_ieee.pdf (9.34 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02859914 , version 1 (08-06-2020)

Identifiants

Citer

Remy Maxence, Hideaki Uchiyama, Hiroshi Kawasaki, Diego Thomas, Vincent Nozick, et al.. Mobile photometric stereo with keypoint-based SLAM for dense 3D reconstruction. 2019 International Conference on 3D Vision (3DV), Sep 2019, Québec City, Canada. pp.574-582, ⟨10.1109/3DV.2019.00069⟩. ⟨hal-02859914⟩
48 Consultations
100 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More