Virtual Gesture Control of Sound Synthesis: Analysis and Classification of Percussion Gestures - Archive ouverte HAL
Article Dans Une Revue Acta Acustica united with Acustica Année : 2010

Virtual Gesture Control of Sound Synthesis: Analysis and Classification of Percussion Gestures

Résumé

In recent years, the control of virtual instruments or sound-synthesis processes by natural gestures has become an important research field, both for building new audio-visual tools and for exploring gesture-sound relationships. Such multimodal and interactive tools typically present two advantages, on the one hand they provide realistic virtual instruments whose response can be compared to existing musical instruments, and on the other hand they give the possibility to vary characteristics of natural gestures, while ensuring a certain coherence between gesture and sound parameters. In this paper, we present and evaluate a new framework for explicitly expressing the characteristics of natural percussion gestures used for modeling, controlling and finally synthesizing new percussion gestures. A preliminary analysis of pre-recorded gestures leads to the identification and evaluation of significant parameters using a classification approach. This analysis shows that a reduced-dimension representation of captured motion can be used to control a virtual character. Furthermore, the simulated gestures provide dynamical variables that can be used to control sound synthesis through a mapping-interaction process.
Fichier principal
Vignette du fichier
AAA10.pdf (1.1 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00763258 , version 1 (02-01-2013)

Identifiants

Citer

Alexandre Bouënard, Marcelo Mortensen Wanderley, Sylvie Gibet. Virtual Gesture Control of Sound Synthesis: Analysis and Classification of Percussion Gestures. Acta Acustica united with Acustica, 2010, 96 (4), pp.668-677. ⟨10.3813/AAA.918321⟩. ⟨hal-00763258⟩
396 Consultations
382 Téléchargements

Altmetric

Partager

More