Statistical and Topological Properties of Sliced Probability Divergences - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Statistical and Topological Properties of Sliced Probability Divergences

Résumé

The idea of slicing divergences has been proven to be successful when comparing two probability measures in various machine learning applications including generative modeling, and consists in computing the expected value of a `base divergence' between one-dimensional random projections of the two measures. However, the computational and statistical consequences of such a technique have not yet been well-established. In this paper, we aim at bridging this gap and derive some properties of sliced divergence functions. First, we show that slicing preserves the metric axioms and the weak continuity of the divergence, implying that the sliced divergence will share similar topological properties. We then precise the results in the case where the base divergence belongs to the class of integral probability metrics. On the other hand, we establish that, under mild conditions, the sample complexity of the sliced divergence does not depend on the dimension, even when the base divergence suffers from the curse of dimensionality. We finally apply our general results to the Wasserstein distance and Sinkhorn divergences, and illustrate our theory on both synthetic and real data experiments.

Dates et versions

hal-03269119 , version 1 (23-06-2021)

Identifiants

Citer

Kimia Nadjahi, Alain Durmus, Lénaïc Chizat, Soheil Kolouri, Shahin Shahrampour, et al.. Statistical and Topological Properties of Sliced Probability Divergences. Advances in Neural Processing Systems, 2020, Online, France. ⟨hal-03269119⟩
56 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More