Video attention deviation estimation using inter-frame visual saliency map analysis - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2012

Video attention deviation estimation using inter-frame visual saliency map analysis

Résumé

A viewer's visual attention during video playback is the matching of his eye gaze movement to the changing video content over time. If the gaze movement matches the video content (e.g., follow a rolling soccer ball), then the viewer keeps his visual attention. If the gaze location moves from one video object to another, then the viewer shifts his visual attention. A video that causes a viewer to shift his attention often is a ''busy'' video. Determination of which video content is busy is an important practical problem; a busy video is difficult for encoder to deploy region of interest (ROI)-based bit allocation, and hard for content provider to insert additional overlays like advertisements, making the video even busier. One way to determine the busyness of video content is to conduct eye gaze experiments with a sizable group of test subjects, but this is time-consuming and cost-ineffective. In this paper, we propose an alternative method to determine the busyness of video---formally called video attention deviation (VAD)---by analyzing the spatial visual saliency maps of the video frames across time. We first derive transition probabilities of a Markov model for eye gaze using saliency maps of a number of consecutive frames. We then compute steady state probability of the saccade state in the model---our estimate of VAD. We demonstrate that the computed steady state probability for saccade using saliency map analysis matches that computed using actual gaze traces. Further, our analysis can also be used to segment video into shorter clips of different degrees of busyness by computing the Kullback-Leibler divergence using consecutive computed gaze model statistics.
Fichier non déposé

Dates et versions

hal-00666000 , version 1 (03-02-2012)

Identifiants

  • HAL Id : hal-00666000 , version 1

Citer

Yunlong Feng, Gene Cheung, Patrick Le Callet, Yusheng Ji. Video attention deviation estimation using inter-frame visual saliency map analysis. Visual Information Processing and Communication III, Jan 2012, San franscisco, United States. pp.1-6. ⟨hal-00666000⟩
105 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More