Findings from Experiments of On-line Joint Reinforcement Learning of Semantic Parser and Dialogue Manager with real Users - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2021

Findings from Experiments of On-line Joint Reinforcement Learning of Semantic Parser and Dialogue Manager with real Users

Bassam Jabaian
Stéphane Huet
Fabrice Lefèvre

Résumé

Design of dialogue systems has witnessed many advances lately, yet acquiring huge set of data remains an hindrance to their fast development for a new task or language. Besides, training interactive systems with batch data is not satisfactory. On-line learning is pursued in this paper as a convenient way to alleviate these difficulties. After the system modules are initiated, a single process handles data collection, annotation and use in training algorithms. A new challenge is to control the cost of the on-line learning borne by the user. Our work focuses on learning the semantic parsing and dialogue management modules (speech recognition and synthesis offer ready-for-use solutions). In this context we investigate several variants of simultaneous learning which are tested in user trials. In our experiments, with varying merits, they can all achieve good performance with only a few hundreds of training dialogues and overstep a handcrafted system. The analysis of these experiments gives us some insights, discussed in the paper, into the difficulty for the system's trainers to establish a coherent and constant behavioural strategy to enable a fast and good-quality training phase.
Fichier principal
Vignette du fichier
2110.13213.pdf (1.4 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04168656 , version 1 (21-07-2023)

Identifiants

Citer

Matthieu Riou, Bassam Jabaian, Stéphane Huet, Fabrice Lefèvre. Findings from Experiments of On-line Joint Reinforcement Learning of Semantic Parser and Dialogue Manager with real Users. 2023. ⟨hal-04168656⟩

Collections

UNIV-AVIGNON LIA
6 Consultations
7 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More