Multimodal Adapted Robot Behavior Synthesis within a Narrative Human-Robot Interaction - Archive ouverte HAL
Communication Dans Un Congrès Année : 2015

Multimodal Adapted Robot Behavior Synthesis within a Narrative Human-Robot Interaction

Amir Aly
Connectez-vous pour contacter l'auteur

Résumé

In human-human interaction, three modalities of communication (i.e., verbal, nonverbal, and paraverbal) are naturally coordinated so as to enhance the meaning of the conveyed message. In this paper, we try to create a similar coordination between these modalities of communication in order to make the robot behave as naturally as possible. The proposed system uses a group of videos in order to elicit specific target emotions in a human user, upon which interactive narratives will start (i.e., interactive discussions between the participant and the robot around each video's content). During each interaction experiment, the humanoid expressive ALICE robot engages and generates an adapted multimodal behavior to the emotional content of the projected video using speech, head-arm metaphoric gestures, and/or facial expressions. The interactive speech of the robot is synthesized using Mary-TTS (text to speech toolkit), which is used-in parallel-to generate adapted head-arm gestures [1]. This synthesized multimodal robot behavior is evaluated by the interacting human at the end of each emotion-eliciting experiment. The obtained results validate the positive effect of the generated robot behavior multimodality on interaction.
Fichier principal
Vignette du fichier
IROS_Aly2015.pdf (1.66 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01203696 , version 2 (05-10-2015)

Licence

Domaine public

Identifiants

  • HAL Id : hal-01203696 , version 2

Citer

Amir Aly, Adriana Tapus. Multimodal Adapted Robot Behavior Synthesis within a Narrative Human-Robot Interaction. The IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Sep 2015, Hambourg, Germany. ⟨hal-01203696⟩
99 Consultations
309 Téléchargements

Partager

More