Performance Analysis of Information Retrieval Systems - Archive ouverte HAL Access content directly
Conference Papers Year : 2014

Performance Analysis of Information Retrieval Systems


It has been shown that there is not a best information retrieval system configuration which would work for any query, but rather that performance can vary from one query to another. It would be interesting if a meta-system could decide which system should process a new query by learning from the context of previously submitted queries. This paper reports a deep analysis considering more than 80,000 search engine configurations applied to 100 queries and the corresponding performance. The goal of the analysis is to identify which search engine configuration responds best to a certain type of query. We considered two approaches to define query types: one is based on query clustering according to the query performance (their difficulty), while the other approach uses various query features (including query difficulty predictors) to cluster queries. We identified two parameters that should be optimized first. An important outcome is that we could not obtain strong conclusive results; considering the large number of systems and methods we used, this result could lead to the conclusion that current query features does not fit the optimizing problem.
Fichier principal
Vignette du fichier
Ayter_13047.pdf (395.95 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01119086 , version 1 (23-02-2015)


  • HAL Id : hal-01119086 , version 1
  • OATAO : 13047


Juli Ayter, Cecile Desclaux, Adrian-Gabriel Chifu, Sébastien Dejean, Josiane Mothe. Performance Analysis of Information Retrieval Systems. 3rd Spanish Conference on Information Retrieval (CERI 2014), Jun 2014, Coruna, Spain. pp.1-12. ⟨hal-01119086⟩
136 View
554 Download


Gmail Facebook X LinkedIn More