Learning optimal audiovisual phasing for a HMM-based control model for facial animation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2007

Learning optimal audiovisual phasing for a HMM-based control model for facial animation

Résumé

We propose here an HMM-based trajectory formation sys- tem that predicts articulatory trajectories of a talking face from phonetic input. In order to add flexibility to the acoustic/ gestural alignment and take into account anticipatory ges- tures, a phasing model has been developed that predicts the delays between the acoustic boundaries of allophones to be synthesized and the gestural boundaries of HMM triphones. The HMM triphones and the phasing model are trained simultaneously using an iterative analysis-synthesis loop. Con- vergence is obtained within a few iterations. We demonstrate here that the phasing model improves significantly the pre- diction error and captures subtle context-dependent antici- patory phenomena.
Fichier principal
Vignette du fichier
og_SSW07.pdf (102.32 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00169576 , version 1 (04-09-2007)

Identifiants

  • HAL Id : hal-00169576 , version 1

Citer

Oxana Govokhina, Gérard Bailly, Gaspard Breton. Learning optimal audiovisual phasing for a HMM-based control model for facial animation. SSW2007 - 6th ISCA Workshop on Speech Synthesis (SSW6), Aug 2007, Bonn, Germany. pp.1-4. ⟨hal-00169576⟩
156 Consultations
50 Téléchargements

Partager

Gmail Facebook X LinkedIn More