Transcribing And Aligning Conversational Speech: A Hybrid Pipeline Applied To French Conversations - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Transcribing And Aligning Conversational Speech: A Hybrid Pipeline Applied To French Conversations

Résumé

With the advent of transformer based models, the use of fully automated ASR-pipelines in a real-world context has come close to a reality. However, for faithful transcription of conversational speech, there remain challenges both in terms of the content predicted by these models (hallucinations, unintended normalizations of disfluencies and transcriptions of background noises) and in terms of alignment accuracy. In this paper we present a hybrid ASR-pipeline which augments transformer models with other algorithms in order to transcribe conversational data. Through experiments on two French datasets, we show that: 1) VAD preprocessing can significantly improve transcription quality as well as word level temporal alignment, 2) prompting can reduce unintended normalizations of disfluencies, 3) heuristic-based detection of untranscribed sounds can further improve alignment quality. We conclude that our hybrid pipeline is an efficient way to improve and augment existing ASR-models.
Fichier principal
Vignette du fichier
ASRU_final_paper.pdf (258.84 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : Copyright (Tous droits réservés)

Dates et versions

hal-04404777 , version 1 (19-01-2024)

Identifiants

  • HAL Id : hal-04404777 , version 1

Citer

Hiroyoshi Yamasaki, Jérôme Louradour, Julie Hunter, Laurent Prevot. Transcribing And Aligning Conversational Speech: A Hybrid Pipeline Applied To French Conversations. 2023 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Dec 2023, Taipei, Taiwan. ⟨hal-04404777⟩
52 Consultations
79 Téléchargements

Partager

Gmail Facebook X LinkedIn More