Emotion Editing in Head Reenactment Videos using Latent Space Manipulation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Emotion Editing in Head Reenactment Videos using Latent Space Manipulation

Résumé

Video generation greatly benefits from integrating facial expressions, as they are highly pertinent in social interaction and hence increase realism in generated talking head videos. Motivated by this, we propose a method for editing emotions in head reenactment videos that is streamlined to modify the latent space of a pre-trained neural head reenactment system. Specifically, our method seeks to disentangle emotions from the latent pose and identity representation. The proposed learning process is based on cycle consistency and image reconstruction losses. Our results suggest that despite its simplicity, such learning successfully decomposes emotion from pose and identity. Our method reproduces facial mimics of a person from a driving video, as well as allows for emotion editing in the reenactment video. We compare our method to the state-of-art for altering emotions in reenactment videos, producing more realistic results that the state-of-art.
Fichier principal
Vignette du fichier
FG2021_Emotions_CameraReady (1).pdf (1.33 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03530150 , version 1 (17-01-2022)

Identifiants

Citer

Valeriya Strizhkova, Yaohui Wang, David Anghelone, Di Yang, Antitza Dantcheva, et al.. Emotion Editing in Head Reenactment Videos using Latent Space Manipulation. FG 2021 - IEEE International Conference on Automatic Face and Gesture Recognition, Dec 2021, Jodhpur, India. ⟨10.1109/FG52635.2021.9667059⟩. ⟨hal-03530150⟩
51 Consultations
301 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More