From Denoising Diffusions to Denoising Markov Models - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2022

From Denoising Diffusions to Denoising Markov Models

Joe Benton
  • Fonction : Auteur
Yuyang Shi
  • Fonction : Auteur
Valentin de Bortoli
  • Fonction : Auteur
  • PersonId : 1084097
  • IdRef : 249460300
George Deligiannidis
  • Fonction : Auteur
Arnaud Doucet
  • Fonction : Auteur

Résumé

Denoising diffusions are state-of-the-art generative models which exhibit remarkable empirical performance and come with theoretical guarantees. The core idea of these models is to progressively transform the empirical data distribution into a simple Gaussian distribution by adding noise using a diffusion. We obtain new samples whose distribution is close to the data distribution by simulating a "denoising" diffusion approximating the time reversal of this "noising" diffusion. This denoising diffusion relies on approximations of the logarithmic derivatives of the noised data densities, known as scores, obtained using score matching. Such models can be easily extended to perform approximate posterior simulation in high-dimensional scenarios where one can only sample from the prior and simulate synthetic observations from the likelihood. These methods have been primarily developed for data on $\mathbb{R}^d$ while extensions to more general spaces have been developed on a case-by-case basis. We propose here a general framework which not only unifies and generalizes this approach to a wide class of spaces but also leads to an original extension of score matching. We illustrate the resulting class of denoising Markov models on various applications.

Dates et versions

hal-03945434 , version 1 (18-01-2023)

Identifiants

Citer

Joe Benton, Yuyang Shi, Valentin de Bortoli, George Deligiannidis, Arnaud Doucet. From Denoising Diffusions to Denoising Markov Models. 2023. ⟨hal-03945434⟩
44 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More