Prediction of visual saliency in video with deep CNNs - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

Prediction of visual saliency in video with deep CNNs

Résumé

Prediction of visual saliency in images and video is a highly researched topic. Target applications include Quality assessment of multimedia services in mobile context, video compression techniques, recognition of objects in video streams, etc. In the framework of mobile and egocentric perspectives, visual saliency models cannot be founded only on bottom-up features, as suggested by feature integration theory. The central bias hypothesis, is not respected neither. In this case, the top-down component of human visual attention becomes prevalent. Visual saliency can be predicted on the basis of seen data. Deep Convolutional Neural Networks (CNN) have proven to be a powerful tool for prediction of salient areas in stills. In our work we also focus on sensitivity of human visual system to residual motion in a video. A Deep CNN architecture is designed, where we incorporate input primary maps as color values of pixels and magnitude of local residual motion. Complementary contrast maps allow for a slight increase of accuracy compared to the use of color and residual motion only. The experiments show that the choice of the input features for the Deep CNN depends on visual task:for th eintersts in dynamic content, the 4K model with residual motion is more efficient, and for object recognition in egocentric video the pure spatial input is more appropriate. © (2016) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Fichier non déposé

Dates et versions

hal-01436651 , version 1 (16-01-2017)

Identifiants

Citer

Souad Chaabouni, Jenny Benois-Pineau, Ofer Hadar. Prediction of visual saliency in video with deep CNNs. SPIE Optical Engineering+ Applications, Aug 2016, San Diego, California, United States. pp.99711Q-99711Q-14, ⟨10.1117/12.2238956⟩. ⟨hal-01436651⟩

Collections

CNRS
79 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More