A Bandit Approach with Evolutionary Operators for Model Selection - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2024

A Bandit Approach with Evolutionary Operators for Model Selection

Résumé

This work formulates model selection as an infinite-armed bandit problem, namely, a problem in which a decision maker iteratively selects one of an infinite number of fixed choices (i.e., arms) when the properties of each choice are only partially known at the time of allocation and may become better understood over time, via the attainment of rewards. Here, the arms are machine learning models to train and selecting an arm corresponds to a partial training of the model (resource allocation). The reward is the accuracy of the selected model after its partial training. We aim to identify the best model at the end of a finite number of resource allocations and thus consider the best arm identification setup. We propose the algorithm Mutant-UCB that incorporates operators from evolutionary algorithms into the UCB-E (Upper Confidence Bound Exploration) bandit algorithm introduced by Audiber et al. Tests carried out on three open source image classification data sets attest to the relevance of this novel combining approach, which outperforms the state-of-the-art for a fixed budget.
Fichier principal
Vignette du fichier
mutantUCB.pdf (624.65 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04440552 , version 1 (06-02-2024)
hal-04440552 , version 2 (13-06-2024)

Identifiants

Citer

Margaux Brégère, Julie Keisler. A Bandit Approach with Evolutionary Operators for Model Selection. 2024. ⟨hal-04440552v2⟩
104 Consultations
121 Téléchargements

Altmetric

Partager

More