A Texture Synthesis Model Based on Semi-discrete Optimal Transport in Patch Space - Archive ouverte HAL
Article Dans Une Revue SIAM Journal on Imaging Sciences Année : 2018

A Texture Synthesis Model Based on Semi-discrete Optimal Transport in Patch Space

Résumé

Exemplar-based texture synthesis consists in producing new synthetic images which have the same perceptual characteristics than a given texture sample while exhibiting sufficient innovation (to avoid verbatim copy). In this paper, we propose to address this problem with a model obtained as local transformations of Gaussian random fields. The local transformations operate on 3x3 patches and are designed to solve a semi-discrete optimal transport problem in order to reimpose the patch distribution of the exemplar texture. The semi-discrete optimal transport problem is solved with a stochastic gradient algorithm, whose convergence speed is evaluated on several practical transport cases.After studying the properties of such transformed Gaussian random fields, we propose a multiscale extension of the model which aims at preserving the patch distribution of the exemplar texture at multiple scales. Experiments demonstrate that this multiscale model is able to synthesize structured textures while keeping several mathematical guarantees, and with low requirements in synthesis time and memory storage. In particular, a single patch optimal transport map is shown to be better than iterated nearest neighbor assignments in terms of statistical guarantees. Besides, once the model is estimated, the resulting synthesis algorithm is fast and highly parallel since it amounts to perform weighted nearest neighbor patch assignments at each scale.
Fichier principal
Vignette du fichier
texto.pdf (140.3 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01726443 , version 1 (08-03-2018)
hal-01726443 , version 2 (15-03-2018)

Identifiants

Citer

Bruno Galerne, Arthur Leclaire, Julien Rabin. A Texture Synthesis Model Based on Semi-discrete Optimal Transport in Patch Space. SIAM Journal on Imaging Sciences, 2018, ⟨10.1137/18M1175781⟩. ⟨hal-01726443v2⟩
857 Consultations
170 Téléchargements

Altmetric

Partager

More