Hand and Lip desynchronization analysis in French Cued Speech: Automatic temporal segmentation of hand flow - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2006

Hand and Lip desynchronization analysis in French Cued Speech: Automatic temporal segmentation of hand flow

Résumé

In the context of Cued Speech gesture phonetic translation, the automatic recognition of lip and hand movements is a key factor. The hand and the lip parameters are not synchronized, thus the fusion of the two channels (hand and lips) needs the knowledge of the desynchronized delay. This contribution focuses on the presentation of an automatic algorithm for temporal segmentation of the hand cue information based on Gaussian modeling of the hand position and minimum of velocity. The segmentation delivers the beginning of the hand transition and the instant of attained position. The hand segmentation is used to calculate the delay between hand and lip targets, in relation with the corresponding acoustic realization in the case of French CV syllables extracted from a corpus of phrases uttered and coded by a Cued Speech speaker. This study confirms in a more complex context the importance of the instant of attained hand position as pointed out by Attina and colleagues, in terms of control and for the fusion process.
Fichier principal
Vignette du fichier
aboutabit.pdf (834.94 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-00261527 , version 1 (07-03-2008)

Identifiants

Citer

Noureddine Aboutabit, Denis Beautemps, Laurent Besacier. Hand and Lip desynchronization analysis in French Cued Speech: Automatic temporal segmentation of hand flow. IEEE ICASSP, May 2006, Toulouse, France. pp.I-633:I-636, ⟨10.1109/ICASSP.2006.1660100⟩. ⟨hal-00261527⟩
192 Consultations
142 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More