The A to Z of Manually Translated Parallel Corpora for the Evaluation of Machine Translation: Establishing Protocols through Experience. Session 5 - Assessing Quality in MT - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2013

The A to Z of Manually Translated Parallel Corpora for the Evaluation of Machine Translation: Establishing Protocols through Experience. Session 5 - Assessing Quality in MT

Résumé

The evaluation of Machine Translation (MT) systems often requires the use of reference translations in order to compare the MT system output against those translations. This comparison allows measuring the quality of the automatic translations. Such reference translations are generally produced by professional translators who follow a series of well-defined protocols and guidelines defined for the specific evaluation data (or corpora) to be produced. The current paper aims at describing in detail how the entire evaluation-data production procedure is carried out. This will imply going through the different stages and needs of the project, the constitution of guidelines, the setting up of protocols and teams, etc. All of it is done bearing in mind that one such project is a dynamic entity and that it evolves as requirements change, feedback from teams is received and as we learn to optimise it through experience.

Mots clés

Fichier principal
Vignette du fichier
Tralogy_S5_A5_Arranz.pdf (628.71 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-02497528 , version 1 (03-03-2020)

Identifiants

  • HAL Id : hal-02497528 , version 1

Citer

Victoria Arranz, Olivier Hamon, Karim Boudahmane, Martine Garnier-Rizet. The A to Z of Manually Translated Parallel Corpora for the Evaluation of Machine Translation: Establishing Protocols through Experience. Session 5 - Assessing Quality in MT. Tralogy II. Trouver le sens : où sont nos manques et nos besoins respectifs ?, Jan 2013, Paris, France. 19p. ⟨hal-02497528⟩
20 Consultations
20 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More