Retina-Enhanced SURF Descriptors for Semantic Concept Detection in Videos - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2012

Retina-Enhanced SURF Descriptors for Semantic Concept Detection in Videos

Résumé

This paper proposes to investigate the potential benefit of the use of low-level human vision behaviors in the context of high-level semantic concept detection. A large part of the current approaches relies on the Bag-of-Words (BoW) model, which has proven itself to be a good choice especially for object recognition in images. Its extension from static images to video sequences exhibits some new problems to cope with, mainly the way to use the added temporal dimension for detecting the target concepts (swimming, drinking...). In this study, we propose to apply a human retina model to preprocess video sequences, before constructing a State-Of-The-Art BoW analysis. This preprocessing, designed in a way that enhances the appearance especially of static image elements, increases the performance by introducing robustness to traditional image and video problems, such as luminance variation, shadows, compression artifacts and noise. These approaches are valuated on the TrecVid 2010 Semantic Indexing task datasets, containing 130 high-level semantic concepts. We consider the well-known SURF descriptor as the entry point of the BoW system, but this work could be extended to any other local gradient based descriptor.
Fichier principal
Vignette du fichier
IPTA-2012-STRAT.pdf (125.86 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00732736 , version 1 (16-09-2012)

Identifiants

  • HAL Id : hal-00732736 , version 1

Citer

Tiberius Strat, Alexandre Benoit, Patrick Lambert, Alice Caplier. Retina-Enhanced SURF Descriptors for Semantic Concept Detection in Videos. IPTA 2012 - 3rd International Conference on Image Processing Theory, Tools and Applications (IPTA 2012), Oct 2012, Istanbul, Turkey. pp.1-6. ⟨hal-00732736⟩
480 Consultations
196 Téléchargements

Partager

Gmail Facebook X LinkedIn More