Learning Optimal Features for Polyphonic Audio-to-Score Alignment - Archive ouverte HAL
Article Dans Une Revue IEEE Transactions on Audio, Speech and Language Processing Année : 2013

Learning Optimal Features for Polyphonic Audio-to-Score Alignment

Cyril Joder
  • Fonction : Auteur
  • PersonId : 919394
AAO

Résumé

This paper addresses the design of feature functions for the matching of a musical recording to the symbolic representation of the piece (the score). These feature functions are defined as dissimilarity measures between the audio observations and template vectors corresponding to the score. By expressing the template construction as a linear mapping from the symbolic to the audio representation, one can learn the feature functions by optimizing the linear transformation. In this paper, we explore two different learning strategies. The first one uses a best-fit criterion (minimum divergence), while the second one exploits a discriminative framework based on a Conditional Random Fields model (maximum likelihood criterion). We evaluate the influence of the feature functions in an audio-to-score alignment task, on a large database of popular and classical polyphonic music. The results show that with several types of models, using different temporal constraints, the learned mappings have the potential to outperform the classic heuristic mappings. Several representations of the audio observations, along with several distance functions are compared in this alignment task. Our experiments elect the symmetric Kullback-Leibler divergence. Moreover, both the spectrogram and a CQT-based representation turn out to provide very accurate alignments, detecting more than 97% of the onsets with a precision of 100 ms with our most complex system.
Fichier principal
Vignette du fichier
2013-Joder-TSALP.pdf (2.33 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02704714 , version 1 (01-06-2020)

Identifiants

  • HAL Id : hal-02704714 , version 1

Citer

Cyril Joder, Slim Essid, Gael Richard. Learning Optimal Features for Polyphonic Audio-to-Score Alignment. IEEE Transactions on Audio, Speech and Language Processing, 2013. ⟨hal-02704714⟩
25 Consultations
121 Téléchargements

Partager

More