Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here But Not Quite There Yet - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here But Not Quite There Yet

Tom Kocmi
  • Fonction : Auteur
Anton Dvorkovich
  • Fonction : Auteur
Mark Fishel
  • Fonction : Auteur
Benjamin Marie
  • Fonction : Auteur
Mariya Shmatova
  • Fonction : Auteur

Résumé

This paper presents the results of the General Machine Translation Task organised as part of the 2023 Conference on Machine Translation (WMT). In the general MT task, participants were asked to build machine translation systems for any of 8 language pairs (covering 14 translation directions), to be evaluated on test sets consisting of up to four different domains. We evaluate system outputs with professional human annotators using a combination of source-based Direct Assessment and scalar quality metric (DA+SQM).
Fichier principal
Vignette du fichier
Findings_of_the_2023_Conference_on_Machine_Translation__WMT23_.pdf (637.65 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04300702 , version 1 (22-11-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04300702 , version 1

Citer

Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondřej Bojar, Anton Dvorkovich, et al.. Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here But Not Quite There Yet. WMT23 - Eighth Conference on Machine Translation, Dec 2023, Singapore, Singapore. pp.198--216. ⟨hal-04300702⟩
86 Consultations
90 Téléchargements

Partager

Gmail Facebook X LinkedIn More