Optimized Population Monte Carlo - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2021

Optimized Population Monte Carlo

Résumé

Adaptive importance sampling (AIS) methods are increasingly used for the approximation of distributions and related intractable integrals in the context of Bayesian inference. Population Monte Carlo (PMC) algorithms are a subclass of AIS methods, widely used due to their ease in the adaptation. In this paper, we propose a novel algorithm that exploits the benefits of the PMC framework and includes more efficient adaptive mechanisms, exploiting geometric information of the target distribution. In particular, the novel algorithm adapts the location and scale parameters of a set of importance densities (proposals). At each iteration, the location parameters are adapted by combining a versatile resampling strategy (i.e., using the information of previous weighted samples) with an advanced optimization-based scheme. Local second-order information of the target distribution is incorporated through a preconditioning matrix acting as a scaling metric onto a gradient direction. A damped Newton approach is adopted to ensure robustness of the scheme. The resulting metric is also used to update the scale parameters of the proposals. We discuss several key theoretical foundations for the proposed approach. Finally, we show the successful performance of the proposed method in three numerical examples, involving challenging distributions.
Fichier principal
Vignette du fichier
LPMC_TSP_R0_HAL.pdf (1.4 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03136318 , version 1 (09-02-2021)
hal-03136318 , version 2 (02-03-2021)
hal-03136318 , version 3 (30-04-2022)

Identifiants

  • HAL Id : hal-03136318 , version 2

Citer

Víctor Elvira, Emilie Chouzenoux. Optimized Population Monte Carlo. 2021. ⟨hal-03136318v2⟩
360 Consultations
448 Téléchargements

Partager

More