The interplay between multisensory integration and perceptual decision making - Centre de Recherche Cerveau et Cognition Accéder directement au contenu
Article Dans Une Revue NeuroImage Année : 2020

The interplay between multisensory integration and perceptual decision making

Manuel R Mercier
  • Fonction : Auteur
  • PersonId : 1087543
Céline Cappe

Résumé

Facing perceptual uncertainty, the brain combines information from different senses to make optimal perceptual decisions and to guide behavior. However, decision making has been investigated mostly in unimodal contexts. Thus, how the brain integrates multisensory information during decision making is still unclear. Two opposing, but not mutually exclusive, scenarios are plausible: either the brain thoroughly combines the signals from different modalities before starting to build a supramodal decision, or unimodal signals are integrated during decision formation. To answer this question, we devised a paradigm mimicking naturalistic situations where human participants were exposed to continuous cacophonous audiovisual inputs containing an unpredictable signal cue in one or two modalities and had to perform a signal detection task or a cue categorization task. First, model-based analyses of behavioral data indicated that multisensory integration takes place alongside perceptual decision making. Next, using supervised machine learning on concurrently recorded EEG, we identified neural signatures of two processing stages: sensory encoding and decision formation. Generalization analyses across experimental conditions and time revealed that multisensory cues were processed faster during both stages. We further established that acceleration of neural dynamics during sensory encoding and decision formation was directly linked to multisensory integration. Our results were consistent across both signal detection and categorization tasks. Taken together, the results revealed a continuous dynamic interplay between multisensory integration and decision making processes (mixed scenario), with integration of multimodal information taking place both during sensory encoding as well as decision formation.
Fichier principal
Vignette du fichier
Mercier-Cappe-NeuroImage-2020.pdf (4.26 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03098359 , version 1 (05-01-2021)

Identifiants

Citer

Manuel R Mercier, Céline Cappe. The interplay between multisensory integration and perceptual decision making. NeuroImage, 2020, 222, ⟨10.1016/j.neuroimage.2020.116970⟩. ⟨hal-03098359⟩
27 Consultations
87 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More