Overview of the INEX 2011 Question Answering Track (QA@INEX)
Résumé
The INEX QA track aimed to evaluate complex question-answering tasks where answers are short texts generated from the Wiki-pedia by extraction of relevant short passages and aggregation into a coherent summary. In such a task, Question-answering, XML/passage retrieval and automatic summarization are combined in order to get closer to real information needs. Based on the groundwork carried out in 2009-2010 edition to determine the sub-tasks and a novel evaluation methodology, the 2011 edition experimented contextualizing tweets using a recent cleaned dump of the Wikipedia. Participants had to contextu-alize 132 tweets from the New York Times (NYT). Informativeness of answers has been evaluated, as well as their readability. 13 teams from 6 countries actively participated to this track. This tweet contextualiza-tion task will continue in 2012 as part of the CLEF INEX lab with same methodology and baseline but on a much wider range of tweet types.
Fichier principal
Overview of the INEX 2011 Question Answering Track.pdf (431.94 Ko)
Télécharger le fichier
| Origine | Fichiers produits par l'(les) auteur(s) |
|---|
Loading...