KinoGroove: Composing with Muscle and Motion in Extended Reality
Résumé
Extended reality and motion capture technologies have been explored as tools for embodied artistic performance, allowing dancers and musicians to interact with sound within immersive environments. However, motion capture systems primarily track gross motor gestures and solid body segments, which restricts their ability to represent dance styles that rely on muscular activation and subtle movement rather than large gestures. Electromyography (EMG), by contrast, captures muscular activity and can reflect finer body movements and soft tissue deformation that may not produce large-scale motion, yet are widely used in dance to convey expressive sensibility. In this work, we present Kino- Groove, an extended reality interface that integrates EMG with motion capture to support expressive mapping of dance to sound. KinoGroove was developed through discussions with dancers and artists, involving close collaboration for testing, feedback, and data acquisition. Our system allows musicians to generate and control musical structures through both visible motion and internal effort, covering a wider range of dance expression. We introduce the KinoGroove design space, which formalizes how EMG signals can function as primary or complementary control parameters for musical output. Through two usage scenarios, one focusing on large-amplitude movements and the other on low-amplitude muscular activation, we illustrate how the system enables artists to shape sound through both spatial displacement and muscular intensity. We finally describe methods for synchronized acquisition, processing, and visualization of motion and EMG data.
Mots clés
- Multimodal Interaction
- Creative Collaboration
- Asynchronous Interaction
- Spatial Sound Composition
- Motion Capture
- Electromyography (EMG)
- Virtual Reality (VR)
- Extended Reality(XR)
- Extended Reality(XR) Virtual Reality (VR) Multimodal Interaction Creative Collaboration Asynchronous Interaction Spatial Sound Composition Motion Capture Electromyography (EMG)
| Origine | Fichiers produits par l'(les) auteur(s) |
|---|---|
| Licence |