Neural Inpainting of Folded Fabrics with Interactive Editing - Archive ouverte HAL
Article Dans Une Revue Computers and Graphics Année : 2024

Neural Inpainting of Folded Fabrics with Interactive Editing

Guillaume Gisbert
Raphaëlle Chaine
David Coeurjolly

Résumé

We propose a deep learning approach for inpainting holes in digital models of fabric surfaces. Leveraging the developable nature of fabric surfaces, we flatten the area surrounding the holes with minor distortion and regularly sample it to obtain a discrete 2D map of the 3D embedding, with an indicator mask outlining holes locations. This enables the use of a standard 2D convolutional neural network to inpaint holes given the 3D positioning of the surface. The provided neural architecture includes an attention mechanism to capture long-range relationships on the surface. Finally, we provide ScarfFolds, a database of folded fabrics patches with varying complexity, which is used to train our convolutional network in a supervised manner. We successfully tested our approach on various examples and illustrated that previous 3D deep learning approaches suffer from several issues when applied to fabrics. Also, our method allows the users to interact with the construction of the inpainted surface. The editing is interactive and supports many tools like vertex grabbing, drape twisting or pinching.
Fichier sous embargo
Fichier sous embargo
0 3 12
Année Mois Jours
Avant la publication
mercredi 8 janvier 2025
Fichier sous embargo
mercredi 8 janvier 2025
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04671536 , version 1 (20-08-2024)

Identifiants

Citer

Guillaume Gisbert, Raphaëlle Chaine, David Coeurjolly. Neural Inpainting of Folded Fabrics with Interactive Editing. Computers and Graphics, 2024, 122, pp.103997. ⟨10.1016/j.cag.2024.103997⟩. ⟨hal-04671536⟩
36 Consultations
0 Téléchargements

Altmetric

Partager

More