Voks: Digital instruments for chironomic control of voice samples - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Speech Communication Année : 2020

Voks: Digital instruments for chironomic control of voice samples

Grégoire Locqueville
  • Fonction : Auteur
Samuel Delalez
  • Fonction : Auteur
Boris Doval
Xiao Xiao
  • Fonction : Auteur

Résumé

This paper presents Voks, a new family of digital instruments that allow for real-time control and modification of pre-recorded voice signal samples. An instrument based on Voks is made of Voks itself, the synthesis software and a given set of chironomic (hand-driven) interfaces. Rhythm can be accurately controlled thanks to a new methodology, based on syllabic control points. Timing can also be controlled with other methods, including scrubbing and playback speed variation. Pitch, vocal effort, voice tension, apparent vocal tract size, voicing ratio, aperiodicity ratio of the voice samples can be modified thanks to a real-time high-quality vocoder. Different forms of chironomic control of the vocal parameters are proposed. Pitch is controlled by continuous hand motions using a stylus on a surface (C-Voks) or a theremin (T-Voks). Other interfaces can be used as well. Syllabic rhythm is controlled using a biphasic button. Scrubbing, playback speed and timbre related parameters can be controlled using the theremin, control surfaces or continuous controllers like faders. In addition to realistic imitation of speaking or singing voices, other playing modes yield new interesting sounds. Voks participated in comparative perceptual evaluation of singing synthesis systems. It has been demonstrated in a live musical settings, using different control interfaces. In addition to musical or poetic performances, applications of performative vocal synthesis to language learning and speech reeducation are foreseen.
Fichier principal
Vignette du fichier
voks2020-rev1.pdf (8.99 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03009712 , version 1 (02-12-2020)

Identifiants

Citer

Grégoire Locqueville, Christophe d'Alessandro, Samuel Delalez, Boris Doval, Xiao Xiao. Voks: Digital instruments for chironomic control of voice samples. Speech Communication, 2020, 125, pp.97 - 113. ⟨10.1016/j.specom.2020.10.002⟩. ⟨hal-03009712⟩
180 Consultations
115 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More