Descriptor Optimization for Multimedia Indexing and Retrieval - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Multimedia Tools and Applications Année : 2015

Descriptor Optimization for Multimedia Indexing and Retrieval

Résumé

In this paper, we propose and evaluate a method for optimizing descriptors used for content-based multimedia indexing and retrieval. A large variety of descriptors are commonly used for this purpose. However, the most efficient ones often have characteristics preventing them to be easily used in large scale systems. They may have very high dimensionality (up to tens of thousands dimensions) and/or be suited for a distance which is costly to compute (e.g. Chi square). The proposed method combines a PCA-based dimensionality reduction with pre- and post-PCA non-linear transformations. The resulting transformation is globally optimized. The produced descriptors have a much lower dimensionality while performing at least as well, and often significantly better, with the Euclidean distance than the original high dimensionality descriptors with their optimal distance. Our approach also includes a hyper-parameter optimization procedure based on the use of a fast kNN classifier and on a polynomial fit to overcome the MAP metric instability. The method has been validated and evaluated on a variety of descriptors using the TRECVid 2010 semantic indexing task data. It has then be applied at large scale for the TRECVid 2012 semantic indexing task on tens of descriptors of various types and with initial dimensionalities ranging from 15 up to 32,768. The same transformation can be used also for multimedia retrieval in the context of query by example and/or of relevance.
Fichier non déposé

Dates et versions

hal-00981672 , version 1 (22-04-2014)

Identifiants

Citer

Bahjat Safadi, Nadia Derbas, Georges Quénot. Descriptor Optimization for Multimedia Indexing and Retrieval. Multimedia Tools and Applications, 2015, 74 (4), pp.1267-1290. ⟨10.1007/s11042-014-2071-6⟩. ⟨hal-00981672⟩
119 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More