Exploratory Visualization Tool for the Continuous Evaluation of Information Retrieval Systems - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Exploratory Visualization Tool for the Continuous Evaluation of Information Retrieval Systems

Résumé

This paper introduces a novel visualization tool that facilitates the exploratory analysis of continuous evaluation for information retrieval systems. We base our analysis on score standardization and meta-analysis techniques applied to Information Retrieval evaluation. We present three functionalities: evaluation overview, delta evaluation, and meta-analysis applied to three perspectives: evaluation rounds, queries, and systems. To illustrate the use of the tool, we provide an example using the TREC-COVID test collection.
Fichier non déposé

Dates et versions

hal-04203082 , version 1 (11-09-2023)

Licence

Paternité

Identifiants

Citer

Gabriela González-Sáez, Petra Galuscáková, Romain Deveaud, Lorraine Goeuriot, Philippe Mulhem. Exploratory Visualization Tool for the Continuous Evaluation of Information Retrieval Systems. SIGIR '23: The 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, Jul 2023, Taipei, Taiwan. pp.3220-3224, ⟨10.1145/3539618.3591825⟩. ⟨hal-04203082⟩
30 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More