Uni MS-PS: a Multi-Scale Encoder Decoder Transformer for Universal Photometric Stereo - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2024

Uni MS-PS: a Multi-Scale Encoder Decoder Transformer for Universal Photometric Stereo

Clément Hardy
  • Fonction : Auteur
  • PersonId : 1164584
Yvain Quéau

Résumé

Photometric Stereo (PS) addresses the challenge of reconstructing a three-dimensional (3D) representation of an object by estimating the 3D normals at all points on the object's surface. This is achieved through the analysis of at least three photographs, all taken from the same viewpoint but with distinct lighting conditions. This paper introduces a novel approach for Universal PS, i.e., when both the active lighting conditions and the ambient illumination are unknown. Our method employs a multi-scale encoder-decoder architecture based on Transformers that allows to accommodates images of any resolutions as well as varying number of input images. We are able to scale up to very high resolution images like 6000 pixels by 8000 pixels without losing performance and maintaining a decent memory footprint. Moreover, experiments on publicly available datasets establish that our proposed architecture improves the accuracy of the estimated normal field by a significant factor compared to state-of-the-art methods. Code and dataset available at: https://clement-hardy.github.io/Uni-MS-PS/index.html
Fichier principal
Vignette du fichier
main_hal.pdf (66.45 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04431103 , version 1 (01-02-2024)
hal-04431103 , version 2 (06-02-2024)

Identifiants

  • HAL Id : hal-04431103 , version 2

Citer

Clément Hardy, Yvain Quéau, David Tschumperlé. Uni MS-PS: a Multi-Scale Encoder Decoder Transformer for Universal Photometric Stereo. 2024. ⟨hal-04431103v2⟩
107 Consultations
7 Téléchargements

Partager

Gmail Facebook X LinkedIn More