Findings of the WMT 2023 Biomedical Translation Shared Task: Evaluation of ChatGPT 3.5 as a Comparison System - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Findings of the WMT 2023 Biomedical Translation Shared Task: Evaluation of ChatGPT 3.5 as a Comparison System

Résumé

We present an overview of the Biomedical Translation Task that was part of the Eighth Conference on Machine Translation (WMT23). The aim of the task was the automatic translation of biomedical abstracts from the PubMed database. It included twelve language directions, namely, French, Spanish, Portuguese, Italian, German, and Russian, from and into English. We received submissions from 18 systems and for all the test sets that we released. Our comparison system was based on Chat-GPT 3.5 and performed very well in comparison to many of the submissions.
Fichier principal
Vignette du fichier
EMNLP_23__WMT23_Biomedical-4.pdf (192.77 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04300785 , version 1 (22-11-2023)

Licence

Identifiants

  • HAL Id : hal-04300785 , version 1

Citer

Mariana Neves, Antonio Jimeno Yepes, Aurélie Névéol, Rachel Bawden, Giorgio Maria Di Nunzio, et al.. Findings of the WMT 2023 Biomedical Translation Shared Task: Evaluation of ChatGPT 3.5 as a Comparison System. WMT23 - Eighth Conference on Machine Translation, Dec 2023, Singapore, Singapore. pp.43--54. ⟨hal-04300785⟩
161 Consultations
86 Téléchargements

Partager

More