Virtual Agent for Deaf Signing Gestures - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue AMSE, Journal of the Association for the Advancement of Modelling and Simulation Techniques in Enterprises Année : 2006

Virtual Agent for Deaf Signing Gestures

Résumé

We describe in this paper a system for automatically synthesizing deaf signing animations from motion data captured on real deaf subjects. Moreover, we create a virtual agent endowed with expressive gestures. Our attention is focused on the expressiveness of gesture (what type of gesture: fluidity, tension, anger) and on its semantic representations. Our approach relies on a data-driven animation scheme. From motion data captured thanks to an optical system and data gloves, we try to extract relevant features of communicative gestures, and to re-synthesize them afterwards with style variation. Within this framework, a motion database containing the whole body, hands motion and facial expressions has been built. The analysis of signals makes possible the enrichment of this database by including segmentation and annotation descriptors. Analysis and synthesis algorithms are applied to the generation of a set of French Sign Language gestures. Key words Communication for deaf people, sign language gestures, virtual signer agent, gesture database.
Fichier principal
Vignette du fichier
Gibet_AMSE.pdf (490.07 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00494241 , version 1 (22-06-2010)

Identifiants

  • HAL Id : hal-00494241 , version 1

Citer

Sylvie Gibet, Alexis Héloir, Nicolas Courty, Jean-François Kamp, Philippe Gorce, et al.. Virtual Agent for Deaf Signing Gestures. AMSE, Journal of the Association for the Advancement of Modelling and Simulation Techniques in Enterprises, 2006, 67, pp.127--136. ⟨hal-00494241⟩
464 Consultations
322 Téléchargements

Partager

Gmail Facebook X LinkedIn More