Article Dans Une Revue SIAM Journal on Imaging Sciences Année : 2025

Joint structure-texture low dimensional modeling for image decomposition with a plug and play framework

Résumé

To address the problem of separating images into a structure and a texture component, we introduce a joint structure-texture model. Instead of considering two separate regularizations for each component, we consider a joint structure-texture model regularization function that takes both components as inputs. This allows for the regularization to take into account the shared information between the two components. We present evidence that shows a performance gain compared to separate regularization models. To implement the joint regularization, we adapt the plug and play framework to our setting, using deep neural networks. We train the corresponding deep prior on a randomly generated synthetic dataset of examples of this model. In the context of image decomposition, we show that while trained on synthetic datasets, our plug and play method generalizes well to natural images. Furthermore, we show that this framework permits to leverage the structure-texture decompositions to solve inverse imaging problems such as inpainting.

Fichier principal
Vignette du fichier
article_joint_structure_texture.pdf (5.38 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04648963 , version 1 (15-07-2024)
hal-04648963 , version 2 (04-11-2024)
hal-04648963 , version 3 (29-11-2024)

Licence

Identifiants

  • HAL Id : hal-04648963 , version 3

Citer

Antoine Guennec, Jean-François Aujol, Yann Traonmilin. Joint structure-texture low dimensional modeling for image decomposition with a plug and play framework. SIAM Journal on Imaging Sciences, 2025. ⟨hal-04648963v3⟩
500 Consultations
833 Téléchargements

Partager

  • More