Benchmarking discrete optimization heuristics with IOHprofiler - Archive ouverte HAL Access content directly
Conference Papers Year :

Benchmarking discrete optimization heuristics with IOHprofiler


Automated benchmarking environments aim to support researchers in understanding how different algorithms perform on different types of optimization problems. Such comparisons carry the potential to provide insights into the strengths and weaknesses of different approaches, which can be leveraged into designing new algorithms. Carefully selected benchmark problems are also needed as training sets in the context of algorithm selection and configuration. With the ultimate goal to create a meaningful benchmark set for iterative optimization heuristics, we compile and assess in this work a selection of discrete optimization problems that subscribe to different types of fitness landscapes. All problems have been implemented and tested within IOHprofiler, our recently released software built to assess iterative heuristics solving combinatorial optimization problems. For each selected problem we compare performances of eleven different heuristics. Apart from fixed-target and fixed-budget results for the individual problems, we also derive ECDF results for groups of problems. To obtain these, we have implemented an add-on for IOHprofiler which allows aggregation of performance data across different benchmark functions.
Fichier principal
Vignette du fichier
bl wksp116s2-file1 (1).pdf (991.11 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02179605 , version 1 (14-01-2020)



Carola Doerr, Furong Ye, Naama Horesh, Hao Wang, Ofer Shir, et al.. Benchmarking discrete optimization heuristics with IOHprofiler. Genetic and Evolutionary Computation Conference, Companion Material, Jul 2019, Prague, Czech Republic. pp.1798-1806, ⟨10.1145/3319619.3326810⟩. ⟨hal-02179605⟩
87 View
226 Download



Gmail Facebook Twitter LinkedIn More