CoachGAN: Fast Adversarial Transfer Learning between differently shaped entities - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

CoachGAN: Fast Adversarial Transfer Learning between differently shaped entities

Mehdi Mounsif
  • Fonction : Auteur
Sebastien Lengagne
Benoit Thuilot

Résumé

In the last decade, robots have been taking an increasingly important place in our societies, and shall the current trend keep the same dynamic,their presence and activities will likely become ubiquitous. As robots will certainly be produced by various industrial actors, it is reasonable to assume that a very diverse robot population will be used by mankind for a broad panel of tasks. As such, it appears probable that robots with a distinct morphology will be required to perform the same task. As an important part of these tasks requires learning-based control and given the millions of interactions steps needed by these approaches to create a single agent, it appears highly desirable to be able to transfer skills from one agent to another despite a potentially different kinematic structure. Correspondingly, this paper introduces a new method, CoachGAN, based on an adversarial framework that allows fast transfer of capacities between a teacher and a student agent. The CoachGAN approach aims at embedding the teacher's way of solving the task within a critic network. Enhanced with the intermediate state variable (ISV) that translates a student state in its teacher equivalent, the critic is then able to guide the student policy in a supervised way in a fraction of the initial training time and without the student having any interaction with the target domain. To demonstrate the flexibility of this approach, CoachGAN is evaluated over a custom tennis task, using various ways to define the intermediate state variables.
Fichier principal
Vignette du fichier
2020_04avril29_icinco_vf.pdf (1.85 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02947364 , version 1 (06-12-2020)

Identifiants

Citer

Mehdi Mounsif, Sebastien Lengagne, Benoit Thuilot, Lounis Adouane. CoachGAN: Fast Adversarial Transfer Learning between differently shaped entities. 17th International Conference on Informatics in Control, Automation and Robotics (ICINCO 2020), Jul 2020, Paris, France. pp.89-96, ⟨10.5220/0009972200890096⟩. ⟨hal-02947364⟩
105 Consultations
43 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More