Question answering on web data : the QA evaluation in Quaero - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2010

Question answering on web data : the QA evaluation in Quaero

Résumé

In the QA and information retrieval domains, progress has been assessed via evaluation campaigns(Clef, Ntcir, Equer, Trec). In these evaluations, the systems handle independent questions and should provide one answer to each question, extracted from textual data, for both open domain and restricted domain. Quæro is a program promoting research and industrial innovation on technologies for automatic analysis and classification of multimedia and multilingual documents. Among the many research areas concerned by Quæro. The Quaero project organized a series of evaluations of Question Answering on Web Data systems in 2008 and 2009. For each language, English and French the full corpus has a size of around 20Gb for 2.5M documents. We describe the task and corpora, and especially the methodologies used in 2008 to construct the test of question and a new one in the 2009 campaign. Six types of questions were addressed, factual, Non-factual(How, Why, What), List, Boolean. A description of the participating systems and the obtained results is provided. We show the difficulty for a question-answering system to work with complex data and questions.
Fichier principal
Vignette du fichier
lrecQuaeroQA.pdf (502.61 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-02282126 , version 1 (09-09-2019)

Identifiants

  • HAL Id : hal-02282126 , version 1

Citer

Ludovic Quintard, Olivier Galibert, Gilles Adda, Brigitte Grau, D Laurent, et al.. Question answering on web data : the QA evaluation in Quaero. International Conference on Language Resources and Evaluation, Jan 2010, Valetta, Malta. ⟨hal-02282126⟩
61 Consultations
22 Téléchargements

Partager

Gmail Facebook X LinkedIn More