Efficient Evaluation Algorithms for Sound Event Detection - Archive ouverte HAL Access content directly
Conference Papers Year : 2023

Efficient Evaluation Algorithms for Sound Event Detection

Algorithmes d'évaluation efficaces pour la détection d'évènements sonores


The prediction of a sound event detection (SED) system may be represented on a timeline by intervals whose bounds correspond to onset and offset respectively. In this context, SED evaluation requires to find all non-empty intersections between predicted and reference intervals. Denoting by M and N the number of predicted events and reference events, the time complexity of exhaustive search is O(M N). This is particularly inefficient when the acoustic scene of interest contains many events (typically above 10 3) or when the detection threshold is low. Our article presents an algorithm for pairwise intersection of intervals by performing binary search within sorted onset and offset times. Computational benchmarks on the BirdVox-full-night dataset confirms that our algorithm is significantly faster than exhaustive search. Moreover, we explain how to use this list of intersecting prediction-reference pairs for the purpose of SED evaluation: the Hopcroft-Karp algorithm guarantees an optimal bipartite matching in time O((M + N) 3/2) in the best case (all events are pairwise disjoint) and O((M + N) 5/2) in the worst case (all events overlap with each other). The solution found by Hopcroft-Karp unambiguously defines a number of true positives, false positives, and false negatives; and ultimately, informationretrieval metrics such as precision, recall, and F-score.
Fichier principal
Vignette du fichier
lostanlen2023dcase_revised-v3.pdf (260.07 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04180328 , version 1 (11-08-2023)
hal-04180328 , version 2 (11-08-2023)
hal-04180328 , version 3 (24-08-2023)


  • HAL Id : hal-04180328 , version 3


Vincent Lostanlen, Brian Mcfee. Efficient Evaluation Algorithms for Sound Event Detection. 8th Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE 2023), Oct 2023, Tampere, Finland. ⟨hal-04180328v3⟩
135 View
134 Download


Gmail Mastodon Facebook X LinkedIn More