Real Time Tracking for 3D Realistic Lip Animation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2006

Real Time Tracking for 3D Realistic Lip Animation

Résumé

This article deals with facial segmentation and liptracking with feedback control for real-time animation of a synthetic 3D face model. Classical approaches consist in two successive steps: video analysis then synthesis. We want to build a global analysis/synthesis processing loop, where the image analysis needs the 3D synthesis and conversely. For that, we fit a generic 3D-face model on the speaker's face in our analysis algorithm for using synthesis information (like 3D information or face shape). This approach is inspired from control systems theory with feedback loops. The contribution of the paper is to use simple image processing techniques on available data, but to improve segmentation through the feedback loop. Moreover, we propose a robust lip corners tracking based on estimation motion algorithm. The speaker is only asked to be in front of the camera with the mouth closed at the beginning of the video session (neutral position). This allows to do a quick initialisation step in order to fit the 3D-face model. Results show that real-time (30Hz) and robust performances are achievable under real-world conditions, which are two key issues for face and lip tracking applications.
Fichier principal
Vignette du fichier
icpr2006.PDF (787.38 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00397978 , version 1 (23-06-2009)

Identifiants

  • HAL Id : hal-00397978 , version 1

Citer

Brice Beaumesnil, Franck Luthon. Real Time Tracking for 3D Realistic Lip Animation. 18th Int. Conf. Pattern Recognition, ICPR'06, Aug 2006, Hong Kong, Hong Kong SAR China. ⟨hal-00397978⟩

Collections

UNIV-PAU LIUPPA
45 Consultations
642 Téléchargements

Partager

Gmail Facebook X LinkedIn More