Learning Robot Speech Models to Predict Speech Acts in HRI - Archive ouverte HAL Access content directly
Journal Articles Paladyn: Journal of Behavioral Robotics Year : 2018

Learning Robot Speech Models to Predict Speech Acts in HRI


In order to be acceptable and able to "camou-flage" into their physio-social context in the long run, robots need to be not just functional, but autonomously psycho-affective as well. This motivates a long term necessity of introducing behavioral autonomy in robots, so they can autonomously communicate with humans without the need of "wizard" intervention. This paper proposes a technique to learn robot speech models from human-robot dialog exchanges. It views the entire exchange in the Automated Planning (AP) paradigm, representing the dialog sequences (speech acts) in the form of action sequences that modify the state of the world upon execution, gradually propelling the state to a desired goal. We then exploit intra-action and interaction dependencies, encoding them in the form of constraints. We attempt to satisfy these constraints using a weighted maximum satisfiability model known as MAX-SAT, and convert the solution into a speech model. This model could have many uses, such as planning of fresh dialogs. In this study, the learnt model is used to predict speech acts in the dialog sequences using the sequence labeling (predicting future acts based on previously seen ones) capabilities of the LSTM (Long Short Term Memory) class of recurrent neural networks. Encouraging empirical results demonstrate the utility of this learnt model and its long term potential to facilitate autonomous behavioral planning of robots, an aspect to be explored in future works.
Fichier principal
Vignette du fichier
pellier18e.pdf (797.63 Ko) Télécharger le fichier
Origin Publisher files allowed on an open archive

Dates and versions

hal-01910362 , version 1 (31-10-2018)



Ankuj Arora, Humbert Fiorino, Damien Pellier, Sylvie Pesty. Learning Robot Speech Models to Predict Speech Acts in HRI. Paladyn: Journal of Behavioral Robotics, 2018, 9 (1), pp.295 - 306. ⟨10.1515/pjbr-2018-0015⟩. ⟨hal-01910362⟩
48 View
63 Download



Gmail Mastodon Facebook X LinkedIn More