Adaptive reinforcement learning with active state-specific exploration for engagement maximization during simulated child-robot interaction - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Paladyn: Journal of Behavioral Robotics Année : 2018

Adaptive reinforcement learning with active state-specific exploration for engagement maximization during simulated child-robot interaction

Résumé

Using assistive robots for educational applications requires robots to be able to adapt their behavior specifically for each child with whom they interact. Among relevant signals, non-verbal cues such as the child's gaze can provide the robot with important information about the child's current engagement in the task, and whether the robot should continue its current behavior or not. Here we propose a reinforcement learning algorithm extended with active state-specific exploration and show its applicability to child engagement maximization as well as more classical tasks such as maze navigation. We first demonstrate its adaptive nature on a continuous maze problem as an enhancement of the classic grid world. There, parame-terized actions enable the agent to learn single moves until the end of a corridor, similarly to "options" but without explicit hierarchical representations. We then apply the algorithm to a series of simulated scenarios, such as an extended Tower of Hanoi where the robot should find the appropriate speed of movement for the interacting child, and to a pointing task where the robot should find the child-specific appropriate level of expressivity of action. We show that the algorithm enables to cope with both global and local non-stationarities in the state space while preserving a stable behavior in other stationary portions of the state space. Altogether, these results suggest a promising way to enable robot learning based on non-verbal cues and the high degree of non-stationarities that can occur during interaction with children.
Fichier principal
Vignette du fichier
Velentzas2018_Paladyn.pdf (3.99 Mo) Télécharger le fichier
Origine : Publication financée par une institution
Loading...

Dates et versions

hal-02324073 , version 1 (21-10-2019)

Licence

Paternité - Pas de modifications

Identifiants

Citer

George Velentzas, Theodore Tsitsimis, Iñaki Rañó, Costas Tzafestas, Mehdi Khamassi. Adaptive reinforcement learning with active state-specific exploration for engagement maximization during simulated child-robot interaction. Paladyn: Journal of Behavioral Robotics, 2018, 9 (1), pp.235-253. ⟨10.1515/pjbr-2018-0016⟩. ⟨hal-02324073⟩
26 Consultations
64 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More