[Données] Comparaison d'approches de reconnaissance d'entités nommées imbriquées dans des documents historiques structurés - Archive ouverte HAL Accéder directement au contenu
Autre Publication Scientifique Année : 2023

[Data] A Benchmark of Nested Named Entity Recognition Approaches in Historical Structured Documents

[Données] Comparaison d'approches de reconnaissance d'entités nommées imbriquées dans des documents historiques structurés

Résumé

Named Entity Recognition (NER) is a key step in the creation of structured data from digitised historical documents. Traditional NER approaches deal with flat named entities, whereas entities often are nested. For example, a postal address might contain a street name and a number. This work compares three nested NER approaches, including two state-of-the-art approaches using Transformer-based architectures. We introduce a new Transformer-based approach based on joint labelling and semantic weighting of errors, evaluated on a collection of 19th-century Paris trade directories. We evaluate approaches regarding the impact of supervised fine-tuning, unsupervised pre-training with noisy texts, and variation of IOB tagging formats. Our results show that while nested NER approaches enable extracting structured data directly, they do not benefit from the extra knowledge provided during training and reach a performance similar to the base approach on flat entities. Even though all 3 approaches perform well in terms of F1 scores, joint labelling is most suitable for hierarchically structured data. Finally, our experiments reveal the superiority of the IO tagging format on such data. This repository references the models that were trained and compared in the following article: Tual, Solenn and Abadie, Nathalie and Carlinet, Edwin and Chazalon, Joseph and Duménieu, Bertrand. A Benchmark of Nested Named Entity Recognition Approaches in Historical Structured Documents. Proceedings of the 17th International Conference on Document Analysis and Recognition (ICDAR'23). Aug. 2023. San José, California, USA. https://doi.org/10.1007/978-3-031-41682-8_8

Mots clés

Fichier non déposé

Dates et versions

hal-04421598 , version 1 (27-01-2024)

Licence

Paternité - Pas d'utilisation commerciale - Partage selon les Conditions Initiales

Identifiants

  • HAL Id : hal-04421598 , version 1

Citer

Solenn Tual, Nathalie Abadie, Edwin Carlinet, Joseph Chazalon, Bertrand Duménieu. [Données] Comparaison d'approches de reconnaissance d'entités nommées imbriquées dans des documents historiques structurés. 2023, https://huggingface.co/nlpso. ⟨hal-04421598⟩

Relations

24 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More