State Representation Learning from Demonstration - Archive ouverte HAL Access content directly
Conference Papers Year : 2020

State Representation Learning from Demonstration

Alexandre Coninx
Stephane Doncieux
Nicolas Perrin


In a context where several policies can be observed as black boxes on different instances of a control task, we propose a method to derive a state representation that can be relied on to reproduce any of the observed policies. We do so via imitation learning on a multi-head neural network consisting of a first part that outputs a common state representation and then one head per policy to imitate. If the demonstrations contain enough diversity, the state representation is general and can be transferred to learn new instances of the task. We present a proof of concept with experimental results on a simulated 2D robotic arm performing a reaching task, with noisy image inputs containing a distractor, and show that the state representations learned provide a greater speed up to end-to-end reinforcement learning on new instances of the task than with other classical representations.

Dates and versions

hal-03083156 , version 1 (18-12-2020)



Astrid Merckling, Alexandre Coninx, Loic Cressot, Stephane Doncieux, Nicolas Perrin. State Representation Learning from Demonstration. 6th International Conference on Machine Learning, Optimization, and Data Science, LOD 2020, Jul 2020, Siena, Italy. ⟨hal-03083156⟩
64 View
0 Download



Gmail Facebook Twitter LinkedIn More