Automatic named entity pre-annotation for out-of-domain human annotation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2013

Automatic named entity pre-annotation for out-of-domain human annotation

Résumé

Automatic pre-annotation is often used to improve human annotation speed and accuracy. We address here out-of-domain named entity annotation, and examine whether automatic pre-annotation is still beneficial in this setting. Our study design includes two different corpora, three pre-annotation schemes linked to two annotation levels, both expert and novice annotators, a questionnaire-based subjective assessment and a corpus-based quantitative assessment. We observe that pre-annotation helps in all cases, both for speed and for accuracy, and that the subjective assessment of the annotators does not always match the actual benefits measured in the annotation outcome.
Fichier non déposé

Dates et versions

hal-01831229 , version 1 (05-07-2018)

Identifiants

  • HAL Id : hal-01831229 , version 1

Citer

Sophie Rosset, Cyril Grouin, Thomas Lavergne, Mohamed Ben Jannet, Jeremy Leixa, et al.. Automatic named entity pre-annotation for out-of-domain human annotation. Linguistic Annotation Workshop, ACL, Jan 2013, Sofia, Bulgaria. ⟨hal-01831229⟩
34 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More