Data and simulations about audiovisual asynchrony and predictability in speech perception - Archive ouverte HAL
Communication Dans Un Congrès Année : 2013

Data and simulations about audiovisual asynchrony and predictability in speech perception

Résumé

Since a paper by Chandrasekaran et al. (2009), an increasing number of neuroscience papers capitalize on the assumption that visual speech would be typically 150 ms ahead of auditory speech. It happens that the estimation of audiovisual asynchrony by Chandrasekaran et al. is valid only in very specific cases, for isolated CV syllables or at the beginning of a speech utterance. We present simple audiovisual data on plosive-vowel syllables (pa, ta, ka, ba, da, ga, ma, na) showing that audiovisual synchrony is actually rather precise when syllables are chained in sequences, as they are typically in most parts of a natural speech utterance. Then we discuss on the way the natural coordination between sound and image (combining cases of lead and lag of the visual input) is reflected in the so-called temporal integration window for audiovisual speech perception (van Wassenhove et al., 2007). We conclude by a computational proposal about predictive coding in such sequences, showing that the visual input may actually provide and enhance predictions even if it is quite synchronous with the auditory input.

Domaines

Psychologie
Fichier principal
Vignette du fichier
Schwartz_Savariaux_AVSP2013_revised.pdf (653.3 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00941310 , version 1 (03-02-2014)

Identifiants

  • HAL Id : hal-00941310 , version 1

Citer

Jean-Luc Schwartz, Christophe Savariaux. Data and simulations about audiovisual asynchrony and predictability in speech perception. AVSP 2013 - 12th International Conference on Auditory-Visual Speech Processing, Aug 2013, Annecy, France. pp.147-152. ⟨hal-00941310⟩
227 Consultations
105 Téléchargements

Partager

More