MA-BBOB: Many-Affine Combinations of BBOB Functions for Evaluating AutoML Approaches in Noiseless Numerical Black-Box Optimization Contexts - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

MA-BBOB: Many-Affine Combinations of BBOB Functions for Evaluating AutoML Approaches in Noiseless Numerical Black-Box Optimization Contexts

Diederick Vermetten
  • Fonction : Auteur
Furong Ye
  • Fonction : Auteur
Thomas Bäck
  • Fonction : Auteur
Carola Doerr

Résumé

Extending a recent suggestion to generate new instances for numerical black-box optimization benchmarking by interpolating pairs of the well-established BBOB functions from the COmparing COntinuous Optimizers (COCO) platform, we propose in this work a further generalization that allows multiple affine combinations of the original instances and arbitrarily chosen locations of the global optima. We demonstrate that the MA-BBOB generator can help fill the instance space, while overall patterns in algorithm performance are preserved. By combining the landscape features of the problems with the performance data, we pose the question of whether these features are as useful for algorithm selection as previous studies suggested. MA-BBOB is built on the publicly available IOHprofiler platform, which facilitates standardized experimentation routines, provides access to the interactive IOHanalyzer module for performance analysis and visualization, and enables comparisons with the rich and growing data collection available for the (MA-)BBOB functions.
Fichier principal
Vignette du fichier
Many_Affine_BBOB__AutoML.pdf (2.95 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04242054 , version 1 (14-10-2023)

Identifiants

Citer

Diederick Vermetten, Furong Ye, Thomas Bäck, Carola Doerr. MA-BBOB: Many-Affine Combinations of BBOB Functions for Evaluating AutoML Approaches in Noiseless Numerical Black-Box Optimization Contexts. International Conference on Automated Machine Learning (AutoML 2023), Sep 2023, Potsdam, Germany. ⟨hal-04242054⟩
33 Consultations
36 Téléchargements

Altmetric

Partager

More