Shaping and Exploring Interactive Motion-Sound Mappings Using Online Clustering Techniques - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

Shaping and Exploring Interactive Motion-Sound Mappings Using Online Clustering Techniques

Résumé

Machine learning tools for designing motion-sound relationships often rely on a two-phase iterative process, where users must alternate between designing gestures and performing mappings. We present a first prototype of a user adaptable tool that aims at merging these design and performance steps into one fully interactive experience. It is based on an online learning implementation of a Gaus-sian Mixture Model supporting real-time adaptation to user movement and generation of sound parameters. To allow both fine-tune modification tasks and open-ended improvi-sational practices, we designed two interaction modes that either let users shape, or guide interactive motion-sound mappings. Considering an improvisational use case, we propose two example musical applications to illustrate how our tool might support various forms of corporeal engagement with sound, and inspire further perspectives for machine learning-mediated embodied musical expression.
Fichier principal
Vignette du fichier
NIME2017_paper_298_cameraready.pdf (1.05 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-01577806 , version 1 (28-08-2017)

Identifiants

  • HAL Id : hal-01577806 , version 1

Citer

Hugo Scurto, Frédéric Bevilacqua, Jules Françoise. Shaping and Exploring Interactive Motion-Sound Mappings Using Online Clustering Techniques. Proceedings of the 17th International Conference on New Interfaces for Musical Expression (NIME 2017), May 2017, Copenhague, Denmark. ⟨hal-01577806⟩
140 Consultations
219 Téléchargements

Partager

Gmail Facebook X LinkedIn More