Investigating Low-Cost LLM Annotation for~Spoken Dialogue Understanding Datasets - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Investigating Low-Cost LLM Annotation for~Spoken Dialogue Understanding Datasets

Valentin Vielzeuf
  • Fonction : Auteur
  • PersonId : 1016921
Yannick Estève

Résumé

In spoken Task-Oriented Dialogue (TOD) systems, the choice of the semantic representation describing the users' requests is key to a smooth interaction. Indeed, the system uses this representation to reason over a database and its domain knowledge to choose its next action. The dialogue course thus depends on the information provided by this semantic representation. While textual datasets provide fine-grained semantic representations, spoken dialogue datasets fall behind. This paper provides insights into automatic enhancement of spoken dialogue datasets' semantic representations. Our contributions are three fold: (1) assess the relevance of Large Language Model fine-tuning, (2) evaluate the knowledge captured by the produced annotations and (3) highlight semi-automatic annotation implications.
Fichier principal
Vignette du fichier
main.pdf (474.74 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04616105 , version 1 (19-06-2024)

Licence

Identifiants

Citer

Lucas Druart, Valentin Vielzeuf, Yannick Estève. Investigating Low-Cost LLM Annotation for~Spoken Dialogue Understanding Datasets. 27th International Conference on Text, Speech and Dialogue, Sep 2024, Brno (Rép. Tchèque), Czech Republic. ⟨hal-04616105⟩

Collections

UNIV-AVIGNON LIA
86 Consultations
54 Téléchargements

Altmetric

Partager

More