Meta-learning of Black-box Solvers Using Deep Reinforcement Learning - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Meta-learning of Black-box Solvers Using Deep Reinforcement Learning

Ludovic dos Santos
Aladin Virmaux
  • Fonction : Auteur
  • PersonId : 964967

Résumé

Black-box optimization does not require any specification on the function we are looking to optimize. As such, it represents one of the most general problems in optimization, and is central in many scientific areas. However in many practical cases, one must solve a sequence of black-box problems from functions originating from a specific class and hence sharing similar patterns. Classical algorithms such as evolutionary or random methods would treat each problem independently and would be oblivious of the general underlying structure. In this paper, we introduce MELBA, an algorithm that exploits the similarities among a given class of functions to learn a task-specific solver that is tailored to efficiently optimize every function from this task. More precisely, given a class of functions, the proposed algorithm learns a Transformer-based Reinforcement Learning (RL) black-box solver. First, the Transformer embeds a previously gathered set of evaluation points and their image through the function into a latent state that characterizes the current stage of the optimization process. Then, the next evaluation point is sampled according to the latent state. The black-box solver is trained using PPO and the global regret on a training set. We show experimentally the effectiveness of our solvers on various synthetic and real-life tasks including the hyperparameter optimization of ML models (SVM, XGBoost) and demonstrate that our approach is competitive with existing methods.
Fichier principal
Vignette du fichier
19_meta_learning_of_black_box_sol.pdf (1.08 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03930140 , version 1 (09-01-2023)

Identifiants

  • HAL Id : hal-03930140 , version 1

Citer

Sofian Chaybouti, Ludovic dos Santos, Cedric Malherbe, Aladin Virmaux. Meta-learning of Black-box Solvers Using Deep Reinforcement Learning. NeurIPS 2022, MetaLearn Workshop, Dec 2022, New Orleans, United States. ⟨hal-03930140⟩
52 Consultations
50 Téléchargements

Partager

Gmail Facebook X LinkedIn More