Integrated vs. Sequential Approaches for Selecting and Tuning CMA-ES Variants - Archive ouverte HAL Access content directly
Conference Papers Year : 2020

Integrated vs. Sequential Approaches for Selecting and Tuning CMA-ES Variants

Abstract

When faced with a specific optimization problem, deciding which algorithm to apply is always a difficult task. Not only is there a vast variety of algorithms to select from, but these algorithms are often controlled by many hyperparameters, which need to be suitably tuned in order to achieve peak performance. Usually, the problem of selecting and configuring the optimization algorithm is addressed sequentially, by first selecting a suitable algorithm and then tuning it for the application at hand. Integrated approaches, commonly known as Combined Algorithm Selection and Hyperparameter (CASH) solvers, have shown promise in several applications. In this work we compare sequential and integrated approaches for selecting and tuning the best out of the 4,608 variants of the modular Covariance Matrix Adaptation Evolution Strategy (CMAES). We show that the ranking of these variants depends to a large extent on the quality of the hyperparameters. Sequential approaches are therefore likely to recommend sub-optimal choices. Integrated approaches, in contrast, manage to provide competitive results at much smaller computational cost. We also highlight important differences in the search behavior of two CASH approaches, which build on racing (irace) and on model-based optimization (MIP-EGO), respectively.
Fichier principal
Vignette du fichier
2020-GECCO-CASH-geccoVersion.pdf (878.92 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02871963 , version 1 (25-06-2020)

Identifiers

Cite

Diederick Vermetten, Hao Wang, Carola Doerr, Thomas Back. Integrated vs. Sequential Approaches for Selecting and Tuning CMA-ES Variants. ACM Genetic and Evolutionary Computation Conference (GECCO'20), ACM, Jul 2020, Cancun, Mexico. ⟨10.1145/3377930.3389831⟩. ⟨hal-02871963⟩
131 View
212 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More