State Representation Learning from Demonstration - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

State Representation Learning from Demonstration

Alexandre Coninx
Stephane Doncieux
Nicolas Perrin

Résumé

In a context where several policies can be observed as black boxes on different instances of a control task, we propose a method to derive a state representation that can be relied on to reproduce any of the observed policies. We do so via imitation learning on a multi-head neural network consisting of a first part that outputs a common state representation and then one head per policy to imitate. If the demonstrations contain enough diversity, the state representation is general and can be transferred to learn new instances of the task. We present a proof of concept with experimental results on a simulated 2D robotic arm performing a reaching task, with noisy image inputs containing a distractor, and show that the state representations learned provide a greater speed up to end-to-end reinforcement learning on new instances of the task than with other classical representations.

Dates et versions

hal-03083156 , version 1 (18-12-2020)

Identifiants

Citer

Astrid Merckling, Alexandre Coninx, Loic Cressot, Stephane Doncieux, Nicolas Perrin. State Representation Learning from Demonstration. 6th International Conference on Machine Learning, Optimization, and Data Science, LOD 2020, Jul 2020, Siena, Italy. ⟨hal-03083156⟩
75 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More