Distant supervision and noisy label learning for low resource named entity recognition: A study on Hausa and Yorùbá - Archive ouverte HAL
Communication Dans Un Congrès Année : 2020

Distant supervision and noisy label learning for low resource named entity recognition: A study on Hausa and Yorùbá

Résumé

The lack of labeled training data has limited the development of natural language processing tools, such as named entity recognition, for many languages spoken in developing countries. Techniques such as distant and weak supervision can be used to create labeled data in a (semi-) automatic way. Additionally, to alleviate some of the negative effects of the errors in automatic annotation, noise-handling methods can be integrated. Pretrained word embeddings are another key component of most neural named entity classifiers. With the advent of more complex contextual word embeddings, an interesting trade-off between model size and performance arises. While these techniques have been shown to work well in highresource settings, we want to study how they perform in low-resource scenarios. In this work, we perform named entity recognition for Hausa and Yorùbá, two languages that are widely spoken in several developing countries. We evaluate different embedding approaches and show that distant supervision can be successfully leveraged in a realistic low-resource scenario where it can more than double a classifier's performance.
Fichier principal
Vignette du fichier
adelani_AfricaNLP2020.pdf (176.59 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03359111 , version 1 (29-09-2021)

Identifiants

  • HAL Id : hal-03359111 , version 1

Citer

David Ifeoluwa Adelani, Michael A Hedderich, Dawei Zhu, Esther van den Berg, Dietrich Klakow. Distant supervision and noisy label learning for low resource named entity recognition: A study on Hausa and Yorùbá. ICLR Workshops (AfricaNLP & PML4DC 2020), Apr 2020, Addis Ababa, Ethiopia. ⟨hal-03359111⟩
56 Consultations
299 Téléchargements

Partager

More