Semi-Unbalanced Optimal Transport for Image Restoration and Synthesis - Archive ouverte HAL Access content directly
Preprints, Working Papers, ... (Preprint) Year : 2024

Semi-Unbalanced Optimal Transport for Image Restoration and Synthesis

Simon Mignon
  • Function : Author
  • PersonId : 1366032
Bruno Galerne
Cécile Louchet
  • Function : Author
  • PersonId : 867350

Abstract

In this paper, we build on optimal transport (OT) theory to present a novel asymmetrically unbalanced variant, the semi-unbalanced optimal transport (SUOT), specifically designed for imaging applications with the presence of a reference. SUOT addresses the lack of robustness of OT and the rigidity inherited from its formulation by taking inspiration from the unbalanced OT formulation. Rather than relaxing the constraints on both the source and the target measures, we relax only the marginal related to the reference. We consider both the unregularized and entropy-regularized versions, deriving dual formulations, corresponding minimization algorithms and formulas for the gradient. These derivations enable us to employ SUOT in variational inverse imaging and synthesis problems, as well as a loss for training a neural network. We evaluate the use of SUOT in a reference-driven super-resolution problem and show its benefits. We also incorporate it into a state-of-the-art single-image generation algorithm and show that it leads to increased diversity. Our results advocate for the adoption of SUOT as a general tool for variational and learning-based inverse imaging and synthesis problems with the presence of a reference.
Fichier principal
Vignette du fichier
SUOT_for_img_restoration.pdf (17.39 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04514983 , version 1 (21-03-2024)

Identifiers

  • HAL Id : hal-04514983 , version 1

Cite

Simon Mignon, Bruno Galerne, Moncef Hidane, Cécile Louchet, Julien Mille. Semi-Unbalanced Optimal Transport for Image Restoration and Synthesis. 2024. ⟨hal-04514983⟩
69 View
37 Download

Share

Gmail Mastodon Facebook X LinkedIn More