ArbEngVec : Arabic-English Cross-Lingual Word Embedding Model - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

ArbEngVec : Arabic-English Cross-Lingual Word Embedding Model

Résumé

Word Embeddings (WE) are getting increasingly popular and widely applied in many Natural Language Processing (NLP) applications due to their effectiveness in capturing semantic properties of words; Machine Translation (MT), Information Retrieval (IR) and Information Extraction (IE) are among such areas. In this paper, we propose an open source ArbEngVec which provides several Arabic-English cross-lingual word embedding models. To train our bilingual models, we use a large dataset with more than 93 million pairs of Arabic-English parallel sentences. In addition , we perform both extrinsic and intrinsic evaluations for the different word embedding model variants. The extrinsic evaluation assesses the performance of models on the cross-language Semantic Textual Similarity (STS), while the intrinsic evaluation is based on the Word Translation (WT) task.
Fichier principal
Vignette du fichier
Lachraf-el-al-WANLP.pdf (453.83 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02150003 , version 1 (06-06-2019)

Identifiants

  • HAL Id : hal-02150003 , version 1

Citer

Raki Lachraf, El Moatez Billah Nagoudi, Youcef Ayachi, Ahmed Abdelali, Didier Schwab. ArbEngVec : Arabic-English Cross-Lingual Word Embedding Model. The Fourth Arabic Natural Language Processing Workshop, Jul 2019, Florence, Italy. ⟨hal-02150003⟩
301 Consultations
348 Téléchargements

Partager

Gmail Facebook X LinkedIn More