Interactive Editing in French Sign Language Dedicated to Virtual Signers: Requirements and Challenges - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Universal Access in the Information Society Année : 2016

Interactive Editing in French Sign Language Dedicated to Virtual Signers: Requirements and Challenges

Sylvie Gibet
François Lefebvre-Albaret
  • Fonction : Auteur
  • PersonId : 905576
  • IdRef : 159013747
Ludovic Hamon
Rémi Brun
  • Fonction : Auteur
  • PersonId : 949430
Ahmed Turki
  • Fonction : Auteur
  • PersonId : 949429

Résumé

Signing avatars are increasingly used as an interface for communication to the deaf community. In recent years, an emerging approach uses captured data to edit and generate sign language (SL) gestures. Thanks to motion editing operations (e.g., concatenation, mixing), this method offers the possibility to compose new utterances, thus facilitating the enrichment of the original corpus, enhancing the natural look of the animation, and promoting the avatar’s acceptability. However, designing such an editing system raises many questions. In particular, manipulating existing movements does not guarantee the semantic consistency of the reconstructed actions. A solution is to insert the human operator in a loop for constructing new utterances and to incorporate within the utterance’s structure constraints that are derived from linguistic patterns. This article discusses the main requirements for the whole pipeline design of interactive virtual signers, including: (1) the creation of corpora, (2) the needed resources for motion recording, (3) the annotation process as the heart of the SL editing process, (4) the building, indexing, and querying of a motion database, (5) the virtual avatar animation by editing and composing motion segments, and (6) the conception of a dedicated user interface according to user’ knowledge and abilities. Each step is illustrated by the authors’ recent work and results from the project Sign3D, i.e., an editing system of French Sign Language (LSF) content.
Fichier principal
Vignette du fichier
UAIS_2014_Gibet_Lefebvre_Hamon_Brun_Turki.pdf (3.39 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01367723 , version 1 (09-12-2018)

Identifiants

Citer

Sylvie Gibet, François Lefebvre-Albaret, Ludovic Hamon, Rémi Brun, Ahmed Turki. Interactive Editing in French Sign Language Dedicated to Virtual Signers: Requirements and Challenges. Universal Access in the Information Society, 2016, 15 (4), pp.525-539. ⟨10.1007/s10209-015-0411-6⟩. ⟨hal-01367723⟩
526 Consultations
198 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More