Exploring the Dependencies between Behavioral and Neuro-physiological Time-series Extracted from Conversations between Humans and Artificial Agents - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Exploring the Dependencies between Behavioral and Neuro-physiological Time-series Extracted from Conversations between Humans and Artificial Agents

Résumé

Whole-brain neuroimaging using functional Magnetic Resonance Imaging (fMRI) provides valuable data to localize brain activity in space and time. Here, we use a unique corpus including fMRI and behavior recorded when participants discussed with a human or a conversational robot. Temporal dynamic is crucial when studying conversation, yet identifying relationship between the participants' behavior and their brain activity is technically challenging given the time resolution of fMRI. We propose here an approach developed to extract neurophysiological and behavioral time-series from the corpus and analyse their causal relationships. Preprocessing entails the construction of discrete neurophysiological time-series from functionally well defined brain areas, as well as behavioral time-series describing higher-order behaviors extracted from synchronized raw audio, video and eyetracking recordings. The second step consists in applying machine learning models to predict brain activity on the basis of various aspects of behavior given knowledge about the functional role of the areas under scrutiny. Results demonstrate the specificity of the behaviors allowing the predictions of the activity in functional brain areas.
Fichier principal
Vignette du fichier
ICPRAM_2020_57 (1).pdf (603.59 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02511146 , version 1 (20-11-2020)

Identifiants

Citer

Youssef Hmamouche, Magalie Ochs, Laurent Prevot, Chaminade Thierry. Exploring the Dependencies between Behavioral and Neuro-physiological Time-series Extracted from Conversations between Humans and Artificial Agents. 9th International Conference on Pattern Recognition Applications and Methods, Feb 2020, Valletta, Malta. pp.353-360, ⟨10.5220/0008989503530360⟩. ⟨hal-02511146⟩
167 Consultations
209 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More