Novelty search: a Theoretical Perspective - Archive ouverte HAL
Communication Dans Un Congrès Année : 2019

Novelty search: a Theoretical Perspective

Résumé

Novelty Search is an exploration algorithm driven by the novelty of a behavior. The same individual evaluated at different generations has different fitness values. The corresponding fitness landscape is thus constantly changing and if, at the scale of a single generation , the metaphor of a fitness landscape with peaks and valleys still holds, this is not the case anymore at the scale of the whole evolutionary process. How does this kind of algorithms behave? Is it possible to define a model that would help understand how it works? This understanding is critical to analyse existing Novelty Search variants and design new and potentially more efficient ones. We assert that Novelty Search asymptotically behaves like a uniform random search process in the behavior space. This is an interesting feature, as it is not possible to directly sample in this space: the algorithm has a direct access to the genotype space only, whose relationship to the behavior space is complex. We describe the model and check its consistency on a classical Novelty Search experiment. We also show that it sheds a new light on results of the literature and suggests future research work.
Fichier principal
Vignette du fichier
NS_theory.pdf (1.88 Mo) Télécharger le fichier
figs/random_vs_ns_comparison.pdf (123.42 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02561846 , version 1 (04-05-2020)

Identifiants

Citer

Stephane Doncieux, Alban Laflaquière, Alexandre Coninx. Novelty search: a Theoretical Perspective. GECCO '19: Genetic and Evolutionary Computation Conference, Jul 2019, Prague Czech Republic, France. pp.99-106, ⟨10.1145/3321707.3321752⟩. ⟨hal-02561846⟩
173 Consultations
2171 Téléchargements

Altmetric

Partager

More