Generating Facial Expression Sequences of Complex Emotions with Generative Adversarial Networks - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Generating Facial Expression Sequences of Complex Emotions with Generative Adversarial Networks

Résumé

There is a rising interest in animating realistic virtual agents for multiple purposes in diferent domains. Such a task requires systems capable of generating complex mental states on par with human emotional complexity. Considering the high representational capacity of Generative Adversarial Networks (GANs), it is only natural to consider them in such applications. In this work, we propose a conditional GAN model for generating sequences of facial expressions of categorical complex emotions. Trained on a scarce and highly imbalanced dataset, the proposed model is able to generate realistic variable-length sequences in a single inference step. These expressions of emotional states, of which there are 24 in total, follow the Facial Actions Coding System (FACS) formatting. In the absence of meaningful objective evaluation methods, we propose a deeplearning-based metric to assess the realism of generated Action Unit (AU) sequences: the Action Unit Fréchet Inception Distance (AUFID). Objective and subjective results validate the realism of our generated samples.
Fichier principal
Vignette du fichier
ESTIA_ICMI_2024_Belmekki.pdf (1.68 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04838242 , version 1 (14-12-2024)

Licence

Identifiants

Citer

Zakariae Belmekki, David Gomez, Patrick Reuter, Jun Li, Jean-Claude Martin, et al.. Generating Facial Expression Sequences of Complex Emotions with Generative Adversarial Networks. 26th ACM International Conference on Multimodal Interaction, Nov 2024, San Jose, Costa Rica. pp.361-372, ⟨10.1145/3678957.3685712⟩. ⟨hal-04838242⟩

Collections

CNRS UNIV-BORDEAUX
0 Consultations
0 Téléchargements

Altmetric

Partager

More