The Learnability of the Annotated Input in NMT Replicating (Vanmassenhove and Way, 2018) with OpenNMT - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

The Learnability of the Annotated Input in NMT Replicating (Vanmassenhove and Way, 2018) with OpenNMT

Résumé

In this paper, we reproduce some of the experiments related to neural network training for Machine Translation as reported in (Vanmassenhove and Way, 2018). They annotated a sample from the EN-FR and EN-DE Europarl aligned corpora with syntactic and semantic annotations to train neural networks with the Nematus Neural Machine Translation (NMT) toolkit. Following the original publication, we obtained lower BLEU scores than the authors of the original paper, but on a more limited set of annotations. In the second half of the paper, we try to analyze the difference in the results obtained and suggest some methods to improve the results. We discuss the Byte Pair Encoding (BPE) used in the pre-processing phase and suggest feature ablation in relation to the granularity of syntactic and semantic annotations. The learnability of the annotated input is discussed in relation to existing resources for the target languages. We also discuss the feature representation likely to have been adopted for combining features.
Fichier principal
Vignette du fichier
2020.lrec-1.691.pdf (436.35 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03007136 , version 1 (16-11-2020)

Identifiants

  • HAL Id : hal-03007136 , version 1

Citer

Nicolas Ballier, Nabil Amari, Laure Merat, Jean-Baptiste Yunès. The Learnability of the Annotated Input in NMT Replicating (Vanmassenhove and Way, 2018) with OpenNMT. LREC, ELRA, May 2020, Marseille, France. pp.5631-5640. ⟨hal-03007136⟩
103 Consultations
93 Téléchargements

Partager

Gmail Facebook X LinkedIn More