A Text-To-SL Synthesis System Using 3D Avatar Technology - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

A Text-To-SL Synthesis System Using 3D Avatar Technology

Résumé

In this paper, we present our Text-to-SL system that synthesizes sign language (SL) from a textual specification by means of a 3D virtual signer. This system is based on a multi-channel composition mechanism, which spatially and temporally arranges linguistic elements to generate SL utterances. New hybrid synthesis modules are proposed that enrich our initial SignCom system, combining procedural and data-driven synthesis. They implement grammatical dynamics specific to SL, in particular grammatical inflection mechanisms based on the fundamental concepts of spatiality and iconicity. We also present a methodology and perspectives for automatically translating written text in a spoken language into sign language.
Fichier principal
Vignette du fichier
SLTAT_HybridSynthesis2023.pdf (161.56 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04448987 , version 1 (09-02-2024)

Identifiants

Citer

Sylvie Gibet, Pierre-François Marteau. A Text-To-SL Synthesis System Using 3D Avatar Technology. 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW), Jun 2023, Rhodes Island, France. pp.1-5, ⟨10.1109/ICASSPW59220.2023.10193734⟩. ⟨hal-04448987⟩
21 Consultations
83 Téléchargements

Altmetric

Partager

More