Why do you Think this Query is Difficult? A User Study on Human Query Prediction - Archive ouverte HAL
Communication Dans Un Congrès Année : 2016

Why do you Think this Query is Difficult? A User Study on Human Query Prediction

Résumé

Predicting if a query will be difficult for a system is important to improve retrieval effectiveness by implementing specific processing. There have been several attempts to predict difficulty, both automatically and manually; but without high accuracy at a preretrieval stage. In this paper, we focus rather on understanding why a query is perceived by humans as difficult. We ran two separated but related experiments in which we asked humans to provide both a query difficulty prediction and reasons to explain their prediction. Results show that: (i) reasons can be categorized into 4 classes; (ii) reasons can be framed into closed questions to be answered on a Likert scale; and (iii) some reasons correlate in a coherent way with the human predicted numerical difficulty. On the basis of these results it is possible to derive hints to be provided to help users when formulating their queries and to avoid them to rely on their wrong perception of difficulty.
Fichier principal
Vignette du fichier
mizzaro_16966.pdf (166.85 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04109565 , version 1 (30-05-2023)

Identifiants

Citer

Stefano Mizzaro, Josiane Mothe. Why do you Think this Query is Difficult? A User Study on Human Query Prediction. 39th International ACM SIGIR conference on research and development in Information Retrieval (SIGIR 2016), Jul 2016, Pise, Italy. pp.1073-1076, ⟨10.1145/2911451.2914696⟩. ⟨hal-04109565⟩
36 Consultations
53 Téléchargements

Altmetric

Partager

More