Towards Understanding and Modeling Audiovisual Saliency Based on Talking Faces - Archive ouverte HAL
Communication Dans Un Congrès Année : 2014

Towards Understanding and Modeling Audiovisual Saliency Based on Talking Faces

Naty Ould-Sidaty
  • Fonction : Auteur
  • PersonId : 966829
SIC
Mohamed-Chaker Larabi
SIC
Abdelhakim Saadane
  • Fonction : Auteur
  • PersonId : 951615
SIC

Résumé

Usual attention is an important mechanism of the human visual system. It allows reducing the amount of information to be processed and accelerates the overall process of vision. Several models for images and videos have been proposed in the literature with encouraging results. However, most existing saliency models do not take into account the multimodal aspect of the video (audio and image). In this paper, we propose to investigate the influence of audio on visual attention. From one side, we carried out eye-tracking experiments for recording subjects' eye movement when watching videos. From another side, eye positions (fixation duration) were used for computing and comparing video attention maps (through eye-movements) with and without audio using state-of-the-art measures. Results therefore showed that audio significantly affect the viewer's attention and consequently it must be taken into consideration for the development of any multimedia saliency model. The findings of these experiments have been used for the development of audiovisual saliency model based on talking face. Result obtained with our model were assessed using usual measurements and showed good performance with regards to ground truth.
Fichier non déposé

Dates et versions

hal-01159122 , version 1 (02-06-2015)

Identifiants

Citer

Naty Ould-Sidaty, Mohamed-Chaker Larabi, Abdelhakim Saadane. Towards Understanding and Modeling Audiovisual Saliency Based on Talking Faces. Tenth International Conference on Signal-Image Technology and Internet-Based Systems (SITIS), Nov 2014, Marrakech, Morocco. pp.508 - 515, ⟨10.1109/SITIS.2014.110⟩. ⟨hal-01159122⟩
103 Consultations
0 Téléchargements

Altmetric

Partager

More