Cross-lingual and Cross-domain Transfer Learning for Automatic Term Extraction from Low Resource Data - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Cross-lingual and Cross-domain Transfer Learning for Automatic Term Extraction from Low Resource Data

Résumé

Automatic Term Extraction (ATE) is a key component for domain knowledge understanding and an important basis for further natural language processing applications. Even with persistent improvements, ATE still exhibits weak results exacerbated by small training data inherent to specialized domain corpora. Recently, transformers-based deep neural models, such as BERT, have proven to be efficient in many downstream NLP tasks. However, no systematic evaluation of ATE has been conducted so far. In this paper, we run an extensive study on fine-tuning pre-trained BERT models for ATE. We propose strategies that empirically show BERT's effectiveness using cross-lingual and cross-domain transfer learning to extract single and multi-word terms. Experiments have been conducted on four specialized domains in three languages. The obtained results suggest that BERT can capture cross-domain and cross-lingual terminologically-marked contexts shared by terms, opening a new design-pattern for ATE.
Fichier principal
Vignette du fichier
2022.lrec-1.68.pdf (381.2 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04006074 , version 1 (27-02-2023)

Identifiants

  • HAL Id : hal-04006074 , version 1

Citer

Amir Hazem, Mériem Bouhandi, Florian Boudin, Béatrice Daille. Cross-lingual and Cross-domain Transfer Learning for Automatic Term Extraction from Low Resource Data. Language Resources and Evaluation Conference, Jun 2022, Marseille, France. ⟨hal-04006074⟩
18 Consultations
23 Téléchargements

Partager

Gmail Facebook X LinkedIn More