Turning Normalizing Flows into Monge Maps with Geodesic Gaussian Preserving Flows - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2022

Turning Normalizing Flows into Monge Maps with Geodesic Gaussian Preserving Flows

Résumé

Normalizing Flows (NF) are powerful likelihood-based generative models that are able to trade off between expressivity and tractability to model complex densities. A now well established research avenue leverages optimal transport (OT) and looks for Monge maps, i.e. models with minimal effort between the source and target distributions. This paper introduces a method based on Brenier's polar factorization theorem to transform any trained NF into a more OT-efficient version without changing the final density. We do so by learning a rearrangement of the source (Gaussian) distribution that minimizes the OT cost between the source and the final density. The Gaussian preserving transformation is implemented with the construction of high dimensional divergence free functions and the path leading to the estimated Monge map is further constrain to lie on a geodesic in the space of volume-preserving diffeomorphisms thanks to Euler's equations. The proposed method leads to smooth flows with reduced OT costs for several existing models without affecting the model performance.
Fichier principal
Vignette du fichier
main.pdf (3.97 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03782622 , version 1 (21-09-2022)
hal-03782622 , version 2 (28-09-2022)
hal-03782622 , version 3 (18-10-2022)
hal-03782622 , version 4 (20-10-2022)
hal-03782622 , version 5 (26-04-2023)

Identifiants

Citer

Guillaume Morel, Lucas Drumetz, Simon Benaïchouche, Nicolas Courty, François Rousseau. Turning Normalizing Flows into Monge Maps with Geodesic Gaussian Preserving Flows. 2022. ⟨hal-03782622v4⟩

Collections

LAB-STICC_UBS_2
278 Consultations
215 Téléchargements

Altmetric

Partager

More