Retina enhanced SIFT descriptors for video indexing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2013

Retina enhanced SIFT descriptors for video indexing

Résumé

This paper investigates how the detection of diverse high-level semantic concepts (objects, actions, scene types, persons etc.) in videos can be improved by applying a model of the human retina. A large part of the current approaches for Content-Based Image/Video Retrieval (CBIR/CBVR) relies on the Bag-of-Words (BoW) model, which has shown to perform well especially for object recognition in static images. Nevertheless, the current stateof-the-art framework shows its limits when applied to videos because of the added temporal information. In this paper, we enhance a BoW model based on the classical SIFT local spatial descriptor, by preprocessing videos with a model of the human retina. This retinal preprocessing allows the SIFT descriptor to become aware of temporal information. Our proposed descriptors extend the SIFT genericity to spatio-temporal content, making them interesting for generic video indexing. They also benefit of the retinal spatio-temporal "stability" in the face of various disturbances such as noise, compression artifacts, luminance variations or shadows. The proposed approaches are evaluated on the TRECVID 2012 Semantic Indexing task dataset.
Fichier non déposé

Dates et versions

hal-00875044 , version 1 (21-10-2013)

Identifiants

  • HAL Id : hal-00875044 , version 1

Citer

Tiberius Strat, Alexandre Benoit, Patrick Lambert. Retina enhanced SIFT descriptors for video indexing. 11th International Workshop on Content-Based Multimedia Indexing (CBMI 2013), Jun 2013, Veszprem, Hungary. pp.201-206. ⟨hal-00875044⟩
133 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More