Towards eyegaze-aware analysis and synthesis of audiovisual speech - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2007

Towards eyegaze-aware analysis and synthesis of audiovisual speech

Résumé

Eye gaze plays many important roles in audiovisual speech, especially in face-to-face interactions. Eyelid shapes are known to correlate with gaze direction. This correlation is perceived and should be restored when animating 3D talking heads. This paper presents a data-based construction method that models the user's eyelid geometric deformations caused by gazing and blinking during conversation. This 3D eyelid and gaze model has been used to analyze and automatically reconstruct our German speaker's gaze. This can potentially complement or replace infra-red based eye tracking when it is important to collect not only where the user looks but also how (ocular expressions...). This method may be used as a tool to study expressive speech and gaze patterns related to cognitive activities (speaking, listening, thinking...).
Fichier principal
Vignette du fichier
fe_AVSP07.pdf (1.16 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00169556 , version 1 (04-09-2007)

Identifiants

  • HAL Id : hal-00169556 , version 1

Citer

Frédéric Elisei, Gérard Bailly, Alix Casari, Stephan Raidt. Towards eyegaze-aware analysis and synthesis of audiovisual speech. AVSP 2007 - 6th International Conference on Auditory-Visual Speech Processing, Aug 2007, Hilvarenbeek, Netherlands. pp.50-56. ⟨hal-00169556⟩
241 Consultations
130 Téléchargements

Partager

Gmail Facebook X LinkedIn More