Communication Dans Un Congrès Année : 2016

PROCESSING OF SYMBOLIC MUSIC NOTATION VIA MULTIMODAL PERFORMANCE DATA: BRIAN FERNEYHOUGH'S LEMMA-ICON-EPIGRAM FOR SOLO PIANO, PHASE 1

Résumé

In the "Performance Notes" to his formidable solo piano work Lemma-Icon-Epigram, British composer Brian Ferneyhough proposes a top-down learning strategy. Its first phase would consist in an "overview of gestural patterning", before delving into the notorious rhythmic intricacies of this most complex notation. In the current paper, we propose a methodology for inferring such patterning from multimodal performance data. In particular, we have a) conducted qualitative analysis of the correlations between the performance data (an audio recording, 12-axis acceleration and gyroscope signals captured by inertial sensors, kinect video and MIDI) and the implicit annotation of pitch during a sight-reading performance; b) observed and documented the correspondence between patterns in the gestural signals and patterns in the score annotations and c) produced joint tablature-like representations, which inscribe the gestural patterning back into the notation, while reducing the pitch material by 70-80% of the original. In addition, we have incorporated this representation in videos and interactive multimodal tablatures via the use of INScore. Our work draws from recent studies in the fields of gesture modelling and interaction. It extends the authors' previous work on an embodied model of navigation of complex notation and on an application for offline and real-time gestural control of complex notation by the name GesTCom (Gesture Cutting through Textual Complexity). Future prospects include the probabilistic modelling of gestureto-notation mappings, towards the design of interactive systems which learn along with the performer while cutting through textual complexity.

Fichier principal
Vignette du fichier
18_Antoniadis_tenor2016.pdf (2.4 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-03165886 , version 1 (11-03-2021)

Licence

Identifiants

  • HAL Id : hal-03165886 , version 1

Citer

Pavlos Antoniadis, Frédéric Bevilacqua. PROCESSING OF SYMBOLIC MUSIC NOTATION VIA MULTIMODAL PERFORMANCE DATA: BRIAN FERNEYHOUGH'S LEMMA-ICON-EPIGRAM FOR SOLO PIANO, PHASE 1. International Conference on Technologies for Music Notation and Representation -- TENOR'16, 2016, Cambridge, United Kingdom. ⟨hal-03165886⟩
165 Consultations
355 Téléchargements

Partager

  • More