Sequential stochastic blackbox optimization - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Sequential stochastic blackbox optimization

Résumé

This work considers stochastic optimization problems in which the objective function values can only be computed by a blackbox corrupted by some random noise following an unknown distribution. The method developed is based on sequential stochastic optimization (SSO) : the original problem is decomposed into a sequence of subproblems. Each of these subproblems is solved using a zeroth order version of a sign stochastic gradient descent with momentum algorithm (ZO-Signum) and with an increasingly fine precision. This decomposition allows a good exploration of the space while maintaining the efficiency of the algorithm once it gets close to the solution. Under Lipschitz continuity assumption on the blackbox, a convergence rate in expectation is derived for the ZO-signum algorithm. If, moreover the blackbox is locally convex around its minima, an almost sure convergence rate may be given for the SSO algorithm. Finally, numerical experiments are conducted to compare the SSO algorithm with other state-of-the-art algorithms and to demonstrate its competitiveness.
Fichier non déposé

Dates et versions

hal-04684460 , version 1 (02-09-2024)

Identifiants

  • HAL Id : hal-04684460 , version 1

Citer

Jean Bigeon. Sequential stochastic blackbox optimization. JOPT 2023, CIRRELT, May 2023, Montreal, Canada. ⟨hal-04684460⟩
17 Consultations
0 Téléchargements

Partager

More