How to Evaluate Coreference in Literary Texts? - Archive ouverte HAL Accéder directement au contenu
Poster De Conférence Année : 2023

How to Evaluate Coreference in Literary Texts?

Résumé

In this short paper, we examine the main metrics used to evaluate textual coreference and we detail some of their limitations. We show that a unique score cannot represent the full complexity of the problem at stake, and is thus uninformative, or even misleading. We propose a new way of evaluating coreference, taking into account the context (in our case, the analysis of fictions, esp. novels). More specifically, we propose to distinguish long coreference chains (corresponding to main characters), from short ones (corresponding to secondary characters), and singletons (isolated elements). This way, we hope to get more interpretable and thus more informative results through evaluation.
Fichier principal
Vignette du fichier
main.pdf (697.11 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04367628 , version 1 (30-12-2023)

Identifiants

  • HAL Id : hal-04367628 , version 1

Citer

Ana-Isabel Duron-Tejedor, Pascal Amsili, Thierry Poibeau. How to Evaluate Coreference in Literary Texts?. Computational Humanities Research, Dec 2023, Paris, France. ⟨hal-04367628⟩
13 Consultations
12 Téléchargements

Partager

Gmail Facebook X LinkedIn More