Overview of the INEX 2010 Question Answering Track (QA@INEX) - Archive ouverte HAL
Communication Dans Un Congrès Année : 2011

Overview of the INEX 2010 Question Answering Track (QA@INEX)

Résumé

The INEX Question Answering track (QA@INEX) aims to evaluate a complex question-answering task using the Wikipedia. The set of questions is composed of factoid, precise questions that expect short answers, as well as more complex questions that can be answered by several sentences or by an aggregation of texts from different documents. Long answers have been evaluated based on Kullback Leibler (KL) divergence between n-gram distributions. This allowed summarization systems to participate. Most of them generated a readable extract of sentences from top ranked documents by a state-of-the-art document retrieval engine. Participants also tested several methods of question dis-ambiguation. Evaluation has been carried out on a pool of real questions from OverBlog and Yahoo! Answers. Results tend to show that the baseline-restricted focused IR system minimizes KL divergence but misses read-ability meanwhile summarization systems tend to use longer and stand-alone sentences thus improving readability but increasing KL divergence.

Dates et versions

hal-01320279 , version 1 (23-05-2016)

Identifiants

Citer

Eric Sanjuan, Patrice Bellot, Véronique Moriceau, Xavier Tannier. Overview of the INEX 2010 Question Answering Track (QA@INEX). 9th International Workshop of the Inititative for the Evaluation of XML Retrieval, INEX 2010, Dec 2010, Vught, Netherlands. ⟨10.1007/978-3-642-23577-1_24⟩. ⟨hal-01320279⟩
50 Consultations
0 Téléchargements

Altmetric

Partager

More