Entropy minimizing distributions are worst-case optimal importance proposals - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail (Preprint/Prepublication) Année : 2022

Entropy minimizing distributions are worst-case optimal importance proposals

Résumé

Importance sampling of target probability distributions belonging to a given convex class is considered. Motivated by previous results, the cost of importance sampling is quantified using the relative entropy of the target with respect to proposal distributions. Using a reference measure as a reference for cost, we prove under some general conditions that the worst-case optimal proposal is precisely given by the distribution minimizing entropy with respect to the reference within the considered convex class of distributions. The latter conditions are in particular satisfied when the convex class is defined using a push-forward map defining atomless conditional measures. Applications in which the optimal proposal is Gibbsian and can be practically sampled using Monte Carlo methods are discussed.
Fichier principal
Vignette du fichier
paper_theory.pdf (315.44 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03889404 , version 1 (08-12-2022)

Identifiants

Citer

Frédéric Cérou, Patrick Héas, Mathias Rousset. Entropy minimizing distributions are worst-case optimal importance proposals. 2022. ⟨hal-03889404⟩
42 Consultations
50 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More