Poster De Conférence Année : 2022

Effect of sensory reliability and saccadic eye-movements on multisensory integration in the spatial ventriloquism paradigm

Résumé

In our environment, our senses are continuously exposed to noisy sensory signals thus providing uncertain information about the world. To reduce these uncertainties, we integrate these informations and explore our surroundings through combined eye and head movements (i.e. active perception). Besides, it has been shown that sensory signals are weighted by the reliability of the stimuli (Ernst & Banks, 2002). In the present study we assess the influence of sensory reliability and active perception on multisensory integration in human subjects with psychophysics and eye-tracking approaches. The paradigm is based on the ventriloquist effect. It consisted in the mislocalization of an auditory target when a visual stimulus is presented simultaneously at a different location (Bertelson & Radeau, 1981). The subject task is to localize the auditory target by a mouse click. We tested two visual stimulation sets: 1) a gabor patch within a Gaussian background noise; 2) a cloud of moving dots patch within a random moving dots cloud. Auditory stimulation consisted in a pink-noise stimulus within a constant background white noise. Auditory and visual stimuli are presented at four spatial locations: +/-4 and 12°. Visual reliability is manipulated by changing dot's density or gabor contrast; auditory reliability by varying sound pressure level. This procedure is conducted in two conditions: passive (fixation) or active condition, participant is performing the same localization task while moving the eyes. It allows us to search for saccadic exploration strategies at work in multisensory integration processes. Our results show that localization error of the auditory stimulus increase when visual reliability is high (i.e. visual capture). Besides, subjects make less localization errors when auditory reliability is elevated (less visual capture). Finally, visual capture is lower in active vs passive condition. Multisensory integration processes depend on auditory and visual reliability and are impacted by saccadic eye movements.

Fichier non déposé

Dates et versions

hal-04977898 , version 1 (05-03-2025)

Identifiants

  • HAL Id : hal-04977898 , version 1

Citer

Aurélien Belle, Jean-Charles Quinton, Mathieu Lefort, Alan Chauvin, Nathalie Guyader, et al.. Effect of sensory reliability and saccadic eye-movements on multisensory integration in the spatial ventriloquism paradigm. IMRF 2022 - International Multisensory Research Forum, Jul 2022, Ulm, Germany. ⟨hal-04977898⟩
131 Consultations
0 Téléchargements

Partager

  • More