Multilingual Named Entity Recognition for Medieval Charters using Stacked Embeddings and BERT-based Models - Archive ouverte HAL Access content directly
Conference Papers Year : 2022

Multilingual Named Entity Recognition for Medieval Charters using Stacked Embeddings and BERT-based Models

Sergio Torres Aguilar

Abstract

In recent years the availability of medieval charter texts has increased thanks to advances in OCR and HTR techniques. But the lack of models that automatically structure the textual output continues to hinder the extraction of large-scale lectures from these historical sources that are among the most important for medieval studies. This paper presents the process of annotating and modelling a corpus to automatically detect named entities in medieval charters in Latin, French and Spanish and address the problem of multilingual writing practices in the Late Middle Ages. It introduces a new annotated multilingual corpus and presents a training pipeline using two approaches: (1) a method using contextual and static embeddings coupled to a Bi-LSTM-CRF classifier; (2) a fine-tuning method using the pre-trained multilingual BERT and RoBERTa models. The experiments described here are based on a corpus encompassing about 2.3M words (7576 charters) coming from five charter collections ranging from the 10th to the 15th centuries. The evaluation proves that both multilingual classifiers based on general purpose models and those specifically designed achieve high-performance results and do not show performance drop compared to their monolingual counterparts. This paper describes the corpus and the annotation guideline, and discusses the issues related to the linguistic of the charters, the multilingual writing practices, so as to interpret the results within a larger historical perspective.
Fichier principal
Vignette du fichier
article_NER_multi_LT4HALA.pdf (777.29 Ko) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Dates and versions

hal-03703239 , version 1 (23-06-2022)

Identifiers

  • HAL Id : hal-03703239 , version 1

Cite

Sergio Torres Aguilar. Multilingual Named Entity Recognition for Medieval Charters using Stacked Embeddings and BERT-based Models. Second Workshop on Language Technologies for Historical and Ancient Languages (LT4HALA, 2022), Jun 2022, Marseille, France. ⟨hal-03703239⟩
93 View
96 Download

Share

Gmail Facebook X LinkedIn More