Oscillatory correlates of linguistic prediction and modality effects during listening to auditory-only and audiovisual sentences - Unité de Recherche en Sciences Cognitives et Affectives Accéder directement au contenu
Article Dans Une Revue International Journal of Psychophysiology Année : 2022

Oscillatory correlates of linguistic prediction and modality effects during listening to auditory-only and audiovisual sentences

Résumé

In natural listening situations, understanding spoken sentences requires interactions between several multisensory to linguistic levels of information. In two electroencephalographical studies, we examined the neuronal oscillations of linguistic prediction produced by unimodal and bimodal sentence listening to observe how these brain correlates were affected by the sensory streams delivering linguistic information. Sentence contexts which were strongly predictive of a particular word were ended by a possessive adjective matching or not the gender of the predicted word. Alpha, beta and gamma oscillations were investigated as they were considered to play a crucial role in the predictive process. During the audiovisual or auditory-only listening to sentences, no evidence of word prediction was observed. In contrast, in a more challenging listening situation during which bimodal audiovisual streams switched to unimodal auditory stream, gamma power was sensitive to word prediction based on prior sentence context. Results suggest that prediction spreading from higher sentence levels to lower word levels is optional during unimodal and bimodal sentence listening and is observed when the listening situation is more challenging. Alpha and beta oscillations were found to decrease when semantically constraining sentences were delivered in the audiovisual modality in comparison with the auditory-only modality. Altogether, our findings bear major implications for our understanding of the neural mechanisms that support predictive processing in multimodal language comprehension.

Domaines

Linguistique
Fichier principal
Vignette du fichier
Manuscript_PostPrint.pdf (8.05 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03820446 , version 1 (19-10-2022)

Identifiants

Citer

Angele Brunelliere, Marion Vincent, Laurence Delrue. Oscillatory correlates of linguistic prediction and modality effects during listening to auditory-only and audiovisual sentences. International Journal of Psychophysiology, 2022, 178, pp.9-21. ⟨10.1016/j.ijpsycho.2022.06.003⟩. ⟨hal-03820446⟩
21 Consultations
40 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More