Video viewing: do auditory salient events capture visual attention? - Archive ouverte HAL
Article Dans Une Revue Annals of Telecommunications - annales des télécommunications Année : 2014

Video viewing: do auditory salient events capture visual attention?

Résumé

We assess whether salient auditory events contained in soundtracks modify eye movements when exploring videos. In a previous study, we found that on average, non-spatial sound contained in video soundtracks impacts on eye movements. This result indicates that sound could play a leading part in visual attention models to predict eye movements. In this research, we go further and test whether the effect of sound on eye movements is stronger just after salient auditory events. To automatically spot salient auditory events, we used two auditory saliency models: the Discrete Energy Separation Algorithm and the Energy model. Both models provide a saliency time curve, based on the fusion of several elementary audio features. The most salient auditory events were extracted by thresholding these curves. We examined some eye movements parameters just after these events rather than on all the video frames. We showed that the effect of sound on eye movements (variability between eye positions, saccade amplitude and fixation duration) was not stronger after salient auditory events than on average over entire videos. Thus, we suggest that sound could impact on visual exploration not only after salient events but in a more global way.
Fichier principal
Vignette du fichier
Coutrot_et_al_-_Annals_of_Telecommunications.pdf (596.61 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00779960 , version 1 (22-01-2014)

Identifiants

Citer

Antoine Coutrot, Nathalie Guyader, Gelu Ionescu, Alice Caplier. Video viewing: do auditory salient events capture visual attention?. Annals of Telecommunications - annales des télécommunications, 2014, 69 (1), pp.89-97. ⟨10.1007/s12243-012-0352-5⟩. ⟨hal-00779960⟩
1058 Consultations
329 Téléchargements

Altmetric

Partager

More