A Comprehensive Study of Open-source Libraries for Named Entity Recognition on Handwritten Historical Documents - Archive ouverte HAL
Article Dans Une Revue International Workshop on Document Analysis Systems Année : 2022

A Comprehensive Study of Open-source Libraries for Named Entity Recognition on Handwritten Historical Documents

Claire Bizon Monroc
  • Fonction : Auteur
Blanche Miret
Marie-Laurence Bonhomme
  • Fonction : éditeur scientifique
Christopher Kermorvant
  • Fonction : Auteur

Résumé

In this paper, we propose an evaluation of several state-of-the-art open-source natural language processing (NLP) libraries for named entity recognition (NER) on handwritten historical documents: spaCy, Stanza and Flair. The comparison is carried out on three low-resource multilingual datasets of handwritten historical documents: HOME (a multilingual corpus of medieval charters), Balsac (a corpus of parish records from Quebec), and Esposalles (a corpus of marriage records in Catalan). We study the impact of the document recognition processes (text line detection and handwriting recognition) on the performance of the NER. We show that current off-the-shelf NER libraries yield state-of-the-art results, even on low-resource languages or multilingual documents using multilingual models. We show, in an end-to-end evaluation, that text line detection errors have a greater impact than handwriting recognition errors. Finally, we also report state-of-the-art results on the public Esposalles dataset.
Fichier principal
Vignette du fichier
DAS2022_NER_mlZZktD.pdf (5.05 Mo) Télécharger le fichier

Dates et versions

hal-04056513 , version 1 (03-04-2023)

Identifiants

Citer

Claire Bizon Monroc, Blanche Miret, Marie-Laurence Bonhomme, Christopher Kermorvant. A Comprehensive Study of Open-source Libraries for Named Entity Recognition on Handwritten Historical Documents. International Workshop on Document Analysis Systems, 2022, Lecture Notes in Computer Science, 13237, pp.429-444. ⟨10.1007/978-3-031-06555-2_29⟩. ⟨hal-04056513⟩

Collections

ANR
23 Consultations
131 Téléchargements

Altmetric

Partager

More