Guiding Co-Creative Musical Agents through Real-Time Flute Instrumental Playing Technique Recognition - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Guiding Co-Creative Musical Agents through Real-Time Flute Instrumental Playing Technique Recognition

Marco Fiorini
Nicolas Brochec

Résumé

This paper presents the development of a classifier for real-time flute Instrumental Playing Technique (IPT) recognition. Our classifier, implemented using Convolutional Neural Networks (CNN), shows a solid state-of-the-art accuracy in detecting different flute IPTs, with enough reactivity and steadiness to be accurate in real-time applications. In particular, we use our classifier's output to guide Somax2, a co-creative Corpus-Based Concatenative Synthesis (CBCS) improvisation system developed within the ERC project REACH, of which we are part of. By implementing a new Label Feature in the corpus annotation and in the output selection process of Somax2, we can drive its musical generation through the flute IPT detected by the classifier. Our real-time IPT recognition system offers a new dimension to the Somax2 interaction paradigm, where its artificial agents are now able to responsively engage with the recognized techniques. Contributing to the broader field of human-machine interaction in computer music, our results have potential applications in improvisation, computer-aided composition and new interfaces for musical expression.
Fichier principal
Vignette du fichier
SMC2024_GUIDING_CO_CREATIVE_MUSICAL_AGENTS_THROUGH_REAL_TIME_FLUTE_INSTRUMENTAL_PLAYING_TECHNIQUE_RECOGNITION_CAMERA_READY.pdf (1.24 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04635907 , version 1 (04-07-2024)

Licence

Identifiants

  • HAL Id : hal-04635907 , version 1

Citer

Marco Fiorini, Nicolas Brochec. Guiding Co-Creative Musical Agents through Real-Time Flute Instrumental Playing Technique Recognition. Sound and Music Computing Conference (SMC 2024), Jul 2024, Porto, Portugal. ⟨hal-04635907⟩
172 Consultations
144 Téléchargements

Partager

More