Full-page music symbols recognition: state-of-the-art deep models comparison for handwritten and printed music scores - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2024

Full-page music symbols recognition: state-of-the-art deep models comparison for handwritten and printed music scores

Résumé

The localization and classification of musical symbols on scanned or digital music scores pose significant challenges in Optical Music Recognition, such as similar musical symbol categories and a large number of overlapping tiny musical symbols within high-resolution music scores. Recently, deep learning-based techniques show promising results in addressing these challenges by leveraging object detection models. However, unclear directions in training and evaluation approaches, such as inconsistency between usage of full-page or cropped images, handling image scores at full-page level in high-resolution, reporting results on only specific object categories, missing comprehensive analysis with recent state-of-the-art object detection methods, cause a lack of benchmarking and analyzing the impact of proposed methods in music object recognition. To address these issues, we perform intensive analysis with recent object detection models, exploring effective ways of handling high-resolution images on existing benchmarks. Our goal is to narrow the gap between object detection models designed for common objects and relatively small images compared to music scores, and the unique challenges of music score recognition in terms of object size and resolution. We achieve state-of-the-art results across mAP and Weighted mAP on two challenging datasets, namely DeepScoresV2 and the MUSCIMA++ datasets, by demonstrating the effectiveness of this approach in both printed and handwritten music scores.
Fichier principal
Vignette du fichier
Halv2.pdf (385.23 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04268139 , version 1 (07-11-2023)
hal-04268139 , version 2 (29-02-2024)

Identifiants

  • HAL Id : hal-04268139 , version 2

Citer

Ali Yesilkanat, Yann Soullard, Bertrand Coüasnon, Nathalie Girard. Full-page music symbols recognition: state-of-the-art deep models comparison for handwritten and printed music scores. 2024. ⟨hal-04268139v2⟩
161 Consultations
84 Téléchargements

Partager

Gmail Facebook X LinkedIn More