A multimodal corpus of Human-Human and Human-Robot conversations including synchronized behavioral and neurophysiological recordings - Archive ouverte HAL
Communication Dans Un Congrès Année : 2020

A multimodal corpus of Human-Human and Human-Robot conversations including synchronized behavioral and neurophysiological recordings

Résumé

This paper presents a unique corpus intended to be shared with the community at the crossroad of linguistics and human-robot interactions (HRI). It is the result of an interdisciplinary collaborations within Cognitive Sciences combining social neu-rosciences, computational sciences, robot-ics and linguistics. It was recorded when brain activity of 25 participants was scanned using functional Magnetic Resonance Imaging (fMRI) while having uncon-strained conversations with a fellow human or a conversational robotic head. Behaviors from the participant and the conversant were recorded synchronously (speech, eye-tracking, head and face movements). Manual and automatic analysis of these behaviors provide rich sets of data for the analysis of both behaviors and neurophysiological responses. Examples of results obtained with this corpus are provided.
Fichier principal
Vignette du fichier
Chaminade_SigDial2020.pdf (2.04 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02916070 , version 1 (17-08-2020)

Identifiants

  • HAL Id : hal-02916070 , version 1

Citer

Thierry Chaminade. A multimodal corpus of Human-Human and Human-Robot conversations including synchronized behavioral and neurophysiological recordings. Late-breaking Track at the SIGDIAL Special Session on Physically Situated Dialogue (RoboDIAL-20), Jul 2020, Virtual, United States. ⟨hal-02916070⟩
108 Consultations
82 Téléchargements

Partager

More