Zero-Shot End-To-End Spoken Question Answering In Medical Domain - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Zero-Shot End-To-End Spoken Question Answering In Medical Domain

Résumé

In the rapidly evolving landscape of spoken question- answering (SQA), the integration of large language models (LLMs) has emerged as a transformative development. Con- ventional approaches often entail the use of separate models for question audio transcription and answer selection, resulting in significant resource utilization and error accumulation. To tackle these challenges, we explore the effectiveness of end-to- end (E2E) methodologies for SQA in the medical domain. Our study introduces a novel zero-shot SQA approach, compared to traditional cascade systems. Through a comprehensive evalua- tion conducted on a new open benchmark of 8 medical tasks and 48 hours of synthetic audio, we demonstrate that our approach requires up to 14.7 times fewer resources than a combined 1.3B parameters LLM with a 1.55B parameters ASR model while improving average accuracy by 0.5%. These findings under- score the potential of E2E methodologies for SQA in resource- constrained contexts.
Fichier principal
Vignette du fichier
2406.05876v1.pdf (215.11 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04684874 , version 1 (03-09-2024)

Identifiants

  • HAL Id : hal-04684874 , version 1

Citer

Yanis Labrak, Adel Moumen, Richard Dufour, Mickaël Rouvier. Zero-Shot End-To-End Spoken Question Answering In Medical Domain. Interspeech 2024, Sep 2024, Kos Island, Greece. ⟨hal-04684874⟩
0 Consultations
0 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More