Creating an interactive human/agent loop using multimodal recurrent neural networks - Archive ouverte HAL Access content directly
Conference Papers Year :

Creating an interactive human/agent loop using multimodal recurrent neural networks

Abstract

This paper presents a description of ongoing research that aims to improve the interaction between human and Embodied Conversational Agent (ECA). The main idea is to model the interactive loop between human and agent such as the virtual agent can continuously adapt its behavior according to one's partner. This work, based on recurrent neural network, focuses on non-verbal behavior generation and presents several scientific locks like the multimodality, the intra-personal temporality of multimodal signals or the temporality between partner's social cues. The modeling will be done using the NOXI database containing natural human/human interactions and the nonverbal behavior generation will be tested on the GRETA platform that simulates virtual agents.
Fichier principal
Vignette du fichier
WACAI_2021_Jieyeon_WOO_Relecture.pdf (810.12 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03377542 , version 1 (14-10-2021)

Identifiers

  • HAL Id : hal-03377542 , version 1

Cite

Jieyeon Woo, Catherine I Pelachaud, Catherine Achard. Creating an interactive human/agent loop using multimodal recurrent neural networks. WACAI 2021, Centre National de la Recherche Scientifique [CNRS], Oct 2021, Saint Pierre d'Oléron, France. ⟨hal-03377542⟩
195 View
164 Download

Share

Gmail Facebook Twitter LinkedIn More