Improving Consistency Models with Generator-Induced Flows - Archive ouverte HAL
Pré-Publication, Document De Travail (Preprint/Prepublication) Année : 2024

Improving Consistency Models with Generator-Induced Flows

Thibaut Issenhuth
  • Fonction : Auteur
  • PersonId : 1392093
Ludovic dos Santos
Jean-Yves Franceschi
Alain Rakotomamonjy
  • Fonction : Auteur
  • PersonId : 1102415

Résumé

Consistency models imitate the multi-step sampling of score-based diffusion in a single forward pass of a neural network. They can be learned in two ways: consistency distillation and consistency training. The former relies on the true velocity field of the corresponding differential equation, approximated by a pre-trained neural network. In contrast, the latter uses a single-sample Monte Carlo estimate of this velocity field. The related estimation error induces a discrepancy between consistency distillation and training that, we show, still holds in the continuous-time limit. To alleviate this issue, we propose a novel flow that transports noisy data towards their corresponding outputs derived from the currently trained model --~as a proxy of the true flow. Our empirical findings demonstrate that this approach mitigates the previously identified discrepancy. Furthermore, we present theoretical and empirical evidence indicating that our generator-induced flow surpasses dedicated optimal transport-based consistency models in effectively reducing the noise-data transport cost. Consequently, our method not only accelerates consistency training convergence but also enhances its overall performance. The code is available at: https://github.com/thibautissenhuth/consistency_GC.
Fichier principal
Vignette du fichier
Improving_consistency_models.pdf (3.03 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04611719 , version 1 (13-06-2024)
hal-04611719 , version 2 (14-10-2024)

Licence

Identifiants

  • HAL Id : hal-04611719 , version 2

Citer

Thibaut Issenhuth, Sangchul Lee, Ludovic dos Santos, Jean-Yves Franceschi, Chansoo Kim, et al.. Improving Consistency Models with Generator-Induced Flows. 2024. ⟨hal-04611719v2⟩
87 Consultations
37 Téléchargements

Partager

More