Facial Expressions for Sign Language Synthesis using FACSHuman and AZee - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Facial Expressions for Sign Language Synthesis using FACSHuman and AZee

Résumé

This paper presents an approach to synthesising facial expressions on signing avatars. We implement those generated by a recently proposed set of rules formalised in the AZee framework for French Sign Language. Our methodology combines computer vision, linguistic insights, and morph target animation to address the challenges posed by the synthesis of nuanced facial expressions, which are pivotal for conveying emotions and grammatical cues in Sign Language. By implementing a set of universally applicable morphs and incorporating these advancements into our animation system, we aim to improve the realism and expressiveness of signing avatars. Our findings suggest an enhancement in the synthesis of non-manual signals, which extends to multiple avatars. This work opens new avenues for future research, including the exploration of more sophisticated facial modelling techniques and the potential integration of facial motion capture data to refine the animation of facial expressions further.

Fichier principal
Vignette du fichier
2024.signlang-1.39.pdf (3.1 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04709105 , version 1 (25-09-2024)

Identifiants

  • HAL Id : hal-04709105 , version 1

Citer

Paritosh Sharma, Camille Challant, Michael Filhol. Facial Expressions for Sign Language Synthesis using FACSHuman and AZee. 11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources, May 2024, Turin, Italy. ⟨hal-04709105⟩
27 Consultations
6 Téléchargements

Partager

More