MaD: Mapping by Demonstration for Continuous Sonification - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2014

MaD: Mapping by Demonstration for Continuous Sonification

Résumé

MaD allows for simple and intuitive design of continuous sonic gestural interaction. The motion-sound mapping is automatically learned by the system when movement and sound examples are jointly recorded. In particular, our applications focus on using vocal sounds - recorded while performing action, - as primary material for interaction design. The system integrates of specific probabilistic models with hybrid sound synthesis models. Importantly, the system is independent to the type of motion/gesture sensing devices, and can directly accommodate the use different sensors such as, cameras, contact microphones, and inertial measurement units. The application concerns performing arts, gaming but also medical applications such auditory-aided rehabilitation.

Domaines

Son [cs.SD]
Fichier principal
Vignette du fichier
FranA_oise_Schnell_Bevilacqua_-_2014_-_MaD_Mapping_by_Demonstration_for_Continuous_Sonification.pdf (295.58 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-01061228 , version 1 (05-09-2014)

Identifiants

Citer

Jules Françoise, Norbert Schnell, Frédéric Bevilacqua. MaD: Mapping by Demonstration for Continuous Sonification. ACM SIGGRAPH 2014 Emerging Technologies, Aug 2014, Vancouver, Canada, France. pp.16:1-16:1, ⟨10.1145/2614066.2614099⟩. ⟨hal-01061228⟩
171 Consultations
135 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More