Evaluation of visual information indexing and retrieval - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2012

Evaluation of visual information indexing and retrieval

Résumé

Comparative evaluation of methods and systems is of primarily importance in the domain of visual indexing and retrieval. As in many other domains, it is generally organized by institutions like NIST or by research networks like Pascal or PetaMedia. Evaluations are carried out in the context of periodical campaigns, or benchmarks. In these, one or more visual indexing or retrieval tasks are defined, each with a data collection, relevance judgments, performance measures and an experimentation protocol. Participants submit results computed automatically and blindly and the organizers return the measured performances. These evaluation campaigns are generally concluded by a workshop in which the participants explain how they performed the tasks. The chapter will give an overview of the major evaluation campaigns in the domain and present in detail the tasks, the data collection, the metrics and the protocols used. The state of the art performance in recent campaigns and the lessons learned from these campaigns will also be presented.
Fichier non déposé

Dates et versions

hal-00770880 , version 1 (07-01-2013)

Identifiants

Citer

Georges Quénot, Philippe Joly. Evaluation of visual information indexing and retrieval. Jenny Benois-Pineau, Frédéric Precioso, Matthieu Cord. Visual Indexing and Retrieval, Springer New York, pp.83-96, 2012, SpringerBriefs in Computer Science, 978-1-4614-3587-7. ⟨10.1007/978-1-4614-3588-4_6⟩. ⟨hal-00770880⟩
137 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More