Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstruction - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2021

Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstruction

Di Huang
  • Fonction : Auteur
  • PersonId : 1113742
Zehua Fu
  • Fonction : Auteur
  • PersonId : 1113743
Yunhong Wang
  • Fonction : Auteur
  • PersonId : 1113740

Résumé

Although much progress has been made recently in 3D face reconstruction, most previous work has been devoted to predicting accurate and fine-grained 3D shapes. In contrast, relatively little work has focused on generating high-fidelity face textures. Compared with the prosperity of photo-realistic 2D face image generation, high-fidelity 3D face texture generation has yet to be studied. In this paper, we proposed a novel UV map generation model that predicts the UV map from a single face image. The model consists of a UV sampler and a UV generator. By selectively sampling the input face image's pixels and adjusting their relative locations, the UV sampler generates an incomplete UV map that could faithfully reconstruct the original face. Missing textures in the incomplete UV map are further full-filled by the UV generator. The training is based on pseudo ground truth blended by the 3DMM texture and the input face texture, thus weakly supervised. To deal with the artifacts in the imperfect pseudo UV map, multiple UV map and face image discriminators are leveraged.
Fichier principal
Vignette du fichier
AAAI_Press_Formatting_Instructions_for_Authors_Using_LaTeX__Copy_.pdf (4.89 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03381124 , version 1 (15-10-2021)

Identifiants

  • HAL Id : hal-03381124 , version 1

Citer

Xiangnan Yin, Di Huang, Zehua Fu, Yunhong Wang, Liming Chen. Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstruction. 2021. ⟨hal-03381124⟩
62 Consultations
299 Téléchargements

Partager

More