Overview of the INEX 2011 Question Answering Track (QA@INEX) - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2012

Overview of the INEX 2011 Question Answering Track (QA@INEX)

Résumé

The INEX QA track aimed to evaluate complex question-answering tasks where answers are short texts generated from the Wiki-pedia by extraction of relevant short passages and aggregation into a coherent summary. In such a task, Question-answering, XML/passage retrieval and automatic summarization are combined in order to get closer to real information needs. Based on the groundwork carried out in 2009-2010 edition to determine the sub-tasks and a novel evaluation methodology, the 2011 edition experimented contextualizing tweets using a recent cleaned dump of the Wikipedia. Participants had to contextu-alize 132 tweets from the New York Times (NYT). Informativeness of answers has been evaluated, as well as their readability. 13 teams from 6 countries actively participated to this track. This tweet contextualiza-tion task will continue in 2012 as part of the CLEF INEX lab with same methodology and baseline but on a much wider range of tweet types.
Fichier principal
Vignette du fichier
Overview of the INEX 2011 Question Answering Track.pdf (431.94 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02493676 , version 1 (28-02-2020)

Identifiants

Citer

Eric Sanjuan, Véronique Moriceau, Xavier Tannier, Patrice Bellot, Josiane Mothe. Overview of the INEX 2011 Question Answering Track (QA@INEX). Focused Retrieval of Content and Structure, 10th International Workshop of the Inititative for the Evaluation of XML Retrieval, INEX 2011, pp.188-206, 2012, ⟨10.1007/978-3-642-35734-3_17⟩. ⟨hal-02493676⟩
79 Consultations
694 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More