Rendering embodied experience into multimodal data: concepts, tools and applications for Xenakis' piano performance
Résumé
The main core of the workshop will be the presentation of the system GesTCom (acronym for Gesture Cutting Through Textual Complexity), which has been developed since 2014 in collaboration with IRCAM (interaction-son-musique-mouvement team). GesTCom is a sensor-based environment for the visualization, analysis and following of the pianist’s gestures in relation to the notation. It comprises four modules, implemented in the form of Max/MSP patches featuring the MuBu toolbox and connected to INScore scripts: a) a module for the synchronized recording of multimodal data of a performance ; b) a module for the reproduction and analysis of the data ; c) a module for the processing of the notation on the basis of the data ; d) a module for real-time gestural interaction with the notation.
Origine | Fichiers produits par l'(les) auteur(s) |
---|