Article Dans Une Revue Speech Communication Année : 2026

Hand gesture realisation of contrastive focus in real-time whisper-to-speech synthesis: Investigating the transfer from implicit to explicit control of intonation

Résumé

The ability of speakers to externalise the control of their intonation in the context of voice substitution communication is evaluated in terms of the realisation of a contrastive focus in French. A whisper-to-speech synthesiser is used with gestural interfaces for intonation control, enabling two types of gesture: an isometric finger pressure and an isotonic wrist movement. An original experimental paradigm is designed to elicit a contrastive focus on the /lu/ syllables of nine-syllable sentences by means of a read-question-answer scenario. For all 16 participants, focus was successfully achieved in speech and in both modality transfer situations by increasing the fundamental frequency and duration of the target syllable. Coordination of the articulation of the whispered syllables and the manual intonational control was acquired quickly and easily. Focus realisation by finger pressure or wrist movement showed very similar dynamics in intonation and duration. Overall, although wrist movement was preferred in terms of ease of control, both interfaces were judged to be equal in terms of learning, performance, emotional experience, and cognitive load.

Fichier principal
Vignette du fichier
1-s2.0-S0167639325001591-main.pdf (3.21 Mo) Télécharger le fichier
Origine Publication financée par une institution
Licence

Dates et versions

hal-05448616 , version 1 (08-01-2026)

Licence

Identifiants

Citer

Delphine Charuau, Nathalie Henrich Bernardoni, Silvain Gerber, Olivier Perrotin. Hand gesture realisation of contrastive focus in real-time whisper-to-speech synthesis: Investigating the transfer from implicit to explicit control of intonation. Speech Communication, 2026, 177, pp.103344. ⟨10.1016/j.specom.2025.103344⟩. ⟨hal-05448616⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

  • More