Multimodal-Based Upper Facial Gestures Synthesis for Engaging Virtual Agents - Archive ouverte HAL Access content directly
Poster Communications Year : 2021

Multimodal-Based Upper Facial Gestures Synthesis for Engaging Virtual Agents

Abstract

Myriad of applications involve the interaction of humans with machines, such as reception agents, home assistants, chatbots or autonomous vehicles' agents. Humans can control the virtual agents by the mean of various modalities including sound, vision, and touch. In this paper, we discuss about designing engaging virtual agents with expressive gestures and prosody. We also propose an architecture that generates upper facial movements based on two modalities: speech and text. This paper is part of a work that aims to review the mechanisms that govern multimodal interaction, such as the agent's expressiveness and the adaptation of its behavior, to help remove technological barriers and develop a conversational agent capable of adapting naturally and coherently to its interlocutor.
Fichier principal
Vignette du fichier
WACAI2021_Reviewed.pdf (491 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03377549 , version 1 (14-10-2021)

Identifiers

  • HAL Id : hal-03377549 , version 1

Cite

Mireille Fares, Catherine I Pelachaud, Nicolas Obin. Multimodal-Based Upper Facial Gestures Synthesis for Engaging Virtual Agents. WACAI 2021, Oct 2021, Saint Pierre d'Oléron, France. ⟨hal-03377549⟩
93 View
62 Download

Share

Gmail Facebook X LinkedIn More