The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Evolutionary Computation Année : 2012

The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics

Résumé

The reality gap, that often makes controllers evolved in simulation inefficient once transferred onto the physical robot, remains a critical issue in Evolutionary Robotics (ER). We hypothesize that this gap highlights a conflict between the efficiency of the solutions in simulation and their transferability from simulation to reality: the most efficient solutions in simulation often exploit badly modeled phenomena to achieve high fitness values with unrealistic behaviors. This hypothesis leads to the Transferability approach, a multi-objective formulation of ER in which two main objectives are optimized via a Pareto-based Multi-Objective Evolutionary Algorithm: (1) the fitness and (2) the transferability, estimated by a simulation-to-reality (STR) disparity measure. To evaluate this second objective, a surrogate model of the exact STR disparity is built during the optimization. This Transferability approach has been compared to two reality-based optimization methods, a noise-based approach inspired from Jakobis minimal simulation methodology and a local search approach. It has been validated on two robotic applications: 1) a navigation task with an e-puck robot; 2) a walking task with an 8-DOF quadrupedal robot. For both experimental set-ups, our approach successfully finds efficient and well-transferable controllers only with about ten experiments on the physical robot.
Fichier principal
Vignette du fichier
2012ACLI2214.pdf (13.38 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00687617 , version 1 (15-04-2012)

Identifiants

Citer

Sylvain Koos, Jean-Baptiste Mouret, Stéphane Doncieux. The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics. IEEE Transactions on Evolutionary Computation, 2012, pp.1-25. ⟨10.1109/TEVC.2012.2185849⟩. ⟨hal-00687617⟩
154 Consultations
710 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More