DIP-VBTV: A Color Image Restoration Model combining a Deep Image Prior and a Vector Bundle Total Variation - Archive ouverte HAL Access content directly
Preprints, Working Papers, ... Year : 2021

DIP-VBTV: A Color Image Restoration Model combining a Deep Image Prior and a Vector Bundle Total Variation

Abstract

In this paper, we introduce a new variational model for color image restoration, called DIP-VBTV, which combines two priors: a deep image prior (DIP), which assumes that the restored image can be generated through a neural network and a Vector Bundle Total Variation (VBTV) which generalizes the Vectorial Total Variation (VTV) on vector bundles. VBTV is determined by a geometric triplet: a Riemannian metric on the base manifold, a covariant derivative and a metric on the vector bundle. Whereas VTV prior encourages the restored images to be piece-wise constant, VBTV prior encourages them to be piece-wise parallel with respect to a covariant derivative. For well-chosen geometric triplets, we show that the minimization of VBTV encourages the solutions of the restoration model to share some visual content with the clean image. Then, we show on experiments that DIP-VBTV benefits from this property by outperforming DIP-VTV and state-of-the-art unsupervised methods, which demonstrates the relevance of combining DIP and VBTV priors.
Fichier principal
Vignette du fichier
article_revised.pdf (13.01 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-02994439 , version 1 (07-11-2020)
hal-02994439 , version 2 (04-05-2021)
hal-02994439 , version 3 (17-07-2021)

Identifiers

  • HAL Id : hal-02994439 , version 2

Cite

Thomas Batard, Gloria Haro, Coloma Ballester. DIP-VBTV: A Color Image Restoration Model combining a Deep Image Prior and a Vector Bundle Total Variation. 2021. ⟨hal-02994439v2⟩
319 View
126 Download

Share

Gmail Mastodon Facebook X LinkedIn More