Stein Boltzmann Sampling: A Variational Approach for Global Optimization - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2024

Stein Boltzmann Sampling: A Variational Approach for Global Optimization

Gaëtan Serré
Nicolas Vayatis
  • Fonction : Auteur
  • PersonId : 1134689

Résumé

In this paper, we introduce a new flow-based method for global optimization of Lipschitz functions, called Stein Boltzmann Sampling (SBS). Our method samples from the Boltzmann distribution that becomes asymptotically uniform over the set of the minimizers of the function to be optimized. Candidate solutions are sampled via the \emph{Stein Variational Gradient Descent} algorithm. We prove the asymptotic convergence of our method, introduce two SBS variants, and provide a detailed comparison with several state-of-the-art global optimization algorithms on various benchmark functions. The design of our method, the theoretical results, and our experiments, suggest that SBS is particularly well-suited to be used as a continuation of efficient global optimization methods as it can produce better solutions while making a good use of the budget.
Fichier principal
Vignette du fichier
main.pdf (2.57 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04442217 , version 1 (06-02-2024)
hal-04442217 , version 2 (15-02-2024)
hal-04442217 , version 3 (27-02-2024)
hal-04442217 , version 4 (11-03-2024)
hal-04442217 , version 5 (03-05-2024)

Identifiants

Citer

Gaëtan Serré, Argyris Kalogeratos, Nicolas Vayatis. Stein Boltzmann Sampling: A Variational Approach for Global Optimization. 2024. ⟨hal-04442217v2⟩
37 Consultations
67 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More