End-to-end optimization of goal-driven and visually grounded dialogue systems Harm de Vries - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

End-to-end optimization of goal-driven and visually grounded dialogue systems Harm de Vries

Résumé

End-to-end design of dialogue systems has recently become a popular research topic thanks to powerful tools such as encoder-decoder architectures for sequence-to-sequence learning. Yet, most current approaches cast human-machine dialogue management as a supervised learning problem, aiming at predicting the next utterance of a participant given the full history of the dialogue. This vision is too simplistic to render the intrinsic planning problem inherent to dialogue as well as its grounded nature , making the context of a dialogue larger than the sole history. This is why only chitchat and question answering tasks have been addressed so far using end-to-end architectures. In this paper, we introduce a Deep Reinforcement Learning method to optimize visually grounded task-oriented dialogues , based on the policy gradient algorithm. This approach is tested on a dataset of 120k dialogues collected through Mechanical Turk and provides encouraging results at solving both the problem of generating natural dialogues and the task of discovering a specific object in a complex picture.
Fichier principal
Vignette du fichier
1703.05423.pdf (3.44 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01549642 , version 1 (28-06-2017)

Licence

Paternité

Identifiants

Citer

Florian Strub, Harm de Vries, Jeremie Mary, Bilal Piot, Aaron Courville, et al.. End-to-end optimization of goal-driven and visually grounded dialogue systems Harm de Vries. International Joint Conference on Artificial Intelligence, Aug 2017, Melbourne, Australia. ⟨hal-01549642⟩
462 Consultations
261 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More