BrainPredict: a Tool for Predicting and Visualising Local Brain Activity - Archive ouverte HAL
Communication Dans Un Congrès Année : 2020

BrainPredict: a Tool for Predicting and Visualising Local Brain Activity

Résumé

In this paper, we present a tool allowing dynamic prediction and visualization of an individual's local brain activity during a conversation. The prediction module of this tool is based on classifiers trained using a corpus of human-human and human-robot conversations including fMRI recordings. More precisely, the module takes as input behavioral features computed from raw data, mainly the participant and the interlocutor speech but also the participant's visual input and eye movements. The visualisation module shows in real-time the dynamics of brain active areas synchronised with the behavioral raw data. In addition, it shows which integrated behavioral features are used to predict the activity in individual brain areas.
Fichier principal
Vignette du fichier
2020.lrec-1.88.pdf (836.63 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-02612819 , version 1 (19-05-2020)

Identifiants

  • HAL Id : hal-02612819 , version 1

Citer

Youssef Hmamouche, Laurent Prevot, Magalie Ochs, Thierry Chaminade. BrainPredict: a Tool for Predicting and Visualising Local Brain Activity. Proceedings of The 12th Language Resources and Evaluation Conference, Nov 2020, Marseille, France. pp.703-709. ⟨hal-02612819⟩
307 Consultations
157 Téléchargements

Partager

More