Named and specific entity detection in varied data: The Quaero Named Entity baseline evaluation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2010

Named and specific entity detection in varied data: The Quaero Named Entity baseline evaluation

Olivier Galibert
Ludovic Quintard
  • Fonction : Auteur
  • PersonId : 872360
Claire Nédellec
Sophie Aubin
Laurent Gillard
  • Fonction : Auteur
Jean-Pierre Raysz
  • Fonction : Auteur
Delphine Pois
  • Fonction : Auteur
Dominique Laurent
  • Fonction : Auteur
  • PersonId : 879470

Résumé

The Quaero program that promotes research and industrial innovation on technologies for automatic analysis and classification of multi-media and multilingual documents. Within its context a set of evaluations of Named Entity recognition systems was held in 2009. Four tasks were defined. The first two concerned traditional named entities in French broadcast news for one (a rerun of ESTER 2) and of OCR-ed old newspapers for the other. The third was a gene and protein name extraction in medical abstracts. The last one was the detection of references in patents. Four different partners participated, giving a total of 16 systems. We provide a synthetic descriptions of all of them classifying them by the main approaches chosen (resource-based, rules-based or statistical), without forgetting the fact that any modern system is at some point hybrid. The metric (the relatively standard Slot Error Rate) and the results are also presented and discussed. Finally, a process is ongoing with preliminary acceptance of the partners to ensure the availability for the community of all the corpora used with the exception of the non-Quaero produced ESTER 2 one.
Fichier non déposé

Dates et versions

hal-02496836 , version 1 (09-03-2020)

Identifiants

  • HAL Id : hal-02496836 , version 1

Citer

Olivier Galibert, Ludovic Quintard, Sophie Rosset, Pierre Zweigenbaum, Claire Nédellec, et al.. Named and specific entity detection in varied data: The Quaero Named Entity baseline evaluation. Seventh International Language Resources and Evaluation (LREC'10), 2010, La Valette, Malta. ⟨hal-02496836⟩
55 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More