Toward the Introduction of Auditory Information in Dynamic Visual Attention Models - Archive ouverte HAL
Communication Dans Un Congrès Année : 2013

Toward the Introduction of Auditory Information in Dynamic Visual Attention Models

Résumé

Classical visual attention models only use visual features to predict where observers should look at. However, in daily life, visual information is never perceived without its correspond- ing audio signal. In a previous study, we found that sound modifies visual exploration by comparing the eye movements recorded when viewing videos with or without their original soundtrack. The aim of the presented research is to further understand how sound influences eye movements by control- ling visual and audio contents of the videos, as well as the congruency between them. We describe an experiment with a novel approach in which observers watched videos belonging to four visual categories presenting different visual saliency distributions: landscapes, one moving object, several moving objects and faces. Videos were seen with their original sound- track or with the soundtrack from another video belonging to the same visual category. Using different metrics to ana- lyze the recorded eye movements, we found that sound has an influence only on videos containing faces and several mov- ing objects. The original soundtrack decreases the variability between the eye positions of observers. Finally, we propose some cues to integrate sound information in classical visual attention models.
Fichier principal
Vignette du fichier
Coutrot_et_al_-_WIAMIS_2013.pdf (277.97 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00826237 , version 1 (09-01-2014)

Identifiants

  • HAL Id : hal-00826237 , version 1

Citer

Antoine Coutrot, Nathalie Guyader. Toward the Introduction of Auditory Information in Dynamic Visual Attention Models. WIA2MIS 2013 - 14th International Workshop on Image and Audio Analysis for Multimedia Interactive services, Jul 2013, Paris, France. pp.1-4. ⟨hal-00826237⟩
211 Consultations
273 Téléchargements

Partager

More