Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks - Laboratoire d'Informatique et Systèmes
Pré-Publication, Document De Travail (Preprint/Prepublication) Année : 2024

Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks

Résumé

Dialogue summarization aims to provide a concise and coherent summary of conversations between multiple speakers. While recent advancements in language models have enhanced this process, summarizing dialogues accurately and faithfully remains challenging due to the need to understand speaker interactions and capture relevant information. Indeed, abstractive models used for dialog summarization may generate summaries that contain inconsistencies. We suggest using the semantic information proposed for performing Spoken Language Understanding (SLU) in human-machine dialogue systems for goal-oriented human-human dialogues to obtain a more semantically faithful summary regarding the task. This study introduces three key contributions: First, we propose an exploration of how incorporating task-related information can enhance the summarization process, leading to more semantically accurate summaries. Then, we introduce a new evaluation criterion based on task semantics. Finally, we propose a new dataset version with increased annotated data standardized for research on task-oriented dialogue summarization. The study evaluates these methods using the DECODA corpus, a collection of French spoken dialogues from a call center. Results show that integrating models with task-related information improves summary accuracy, even with varying word error rates.
Fichier principal
Vignette du fichier
twbtdvkwcywhmjktxkrfydzvpkpckzgw.pdf (216.98 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04699645 , version 1 (17-09-2024)

Licence

Identifiants

Citer

Eunice Akani, Benoît Favre, Frédéric Bechet, Romain Gemignani. Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks. 2024. ⟨hal-04699645⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More