The contribution of audiovisual speech to lexical-semantic processing in natural spoken sentences - Archive ouverte HAL Access content directly
Journal Articles Language, Cognition and Neuroscience Year : 2020

The contribution of audiovisual speech to lexical-semantic processing in natural spoken sentences

Abstract

In everyday communication, natural spoken sentences are expressed in a multisensory way through auditory signals and speakers’ visible articulatory gestures. An important issue is to know whether audiovisual speech plays a main role in the linguistic encoding of an utterance until access to meaning. To this end, we conducted an event-related potential experiment during which participants listened passively to spoken sentences and a lexical recognition task. The results revealed that N200 and N400 waves had a greater amplitude after semantically incongruous words than after expected words. This effect of semantic congruency was increased over N200 in the audiovisual trials. Words presented audiovisually also elicited a reduced amplitude of the N400 wave and a facilitated recovery in memory. Our findings shed light on the influence of audiovisual speech on the understanding of natural spoken sentences by acting on the early stages of word recognition in order to access a lexical-semantic network.
Fichier principal
Vignette du fichier
AngèleBrunellière,LaurenceDelrue,CyrilAuran,2020.pdf (1.21 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03185866 , version 1 (30-03-2021)

Identifiers

Cite

Angèle Brunellière, Laurence Delrue, Cyril Auran. The contribution of audiovisual speech to lexical-semantic processing in natural spoken sentences. Language, Cognition and Neuroscience, 2020, Language, Cognition and Neuroscience, 35 (6), pp.694-711. ⟨10.1080/23273798.2019.1641612⟩. ⟨hal-03185866⟩
73 View
132 Download

Altmetric

Share

Gmail Facebook X LinkedIn More