Real-Time Monophonic and Polyphonic Audio Classification from Power Spectra - Archive ouverte HAL Access content directly
Journal Articles Pattern Recognition Year : 2019

Real-Time Monophonic and Polyphonic Audio Classification from Power Spectra


This work addresses the recurring challenge of real-time monophonic and polyphonic audio source classification. The whole normalized power spectrum (NPS) is directly involved in the proposed process, avoiding complex and hazardous traditional feature extraction. It is also a natural candidate for polyphonic events thanks to its additive property in such cases. The classification task is performed through a nonparametric kernel-based generative modeling of the power spectrum. Advantage of this model is twofold: it is almost hypothesis free and it allows to straightforwardly obtain the maximum a posteriori classification rule of online signals. Moreover it makes use of the monophonic dataset to build the polyphonic one. Then, to reach the real-time target, the complexity of the method can be tuned by using a standard hierarchical clustering preprocessing of the prototypes, revealing a particularly efficient computation time and classification accuracy trade-off. The proposed method, called RARE (for Real-time Audio Recognition Engine) reveals encouraging results both in monophonic and polyphonic classification tasks on benchmark and owned datasets, including also the targeted real-time situation. In particular, this method benefits from several advantages compared to the state-of-the-art methods including a reduced training time, no feature extraction, the ability to control the computation - accuracy trade-off and no training on already mixed sounds for polyphonic classification.
Fichier principal
Vignette du fichier
article_v3.pdf (481.51 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01834221 , version 1 (10-07-2018)
hal-01834221 , version 2 (14-01-2019)
hal-01834221 , version 3 (11-03-2019)



Maxime Baelde, Christophe Biernacki, Raphaël Greff. Real-Time Monophonic and Polyphonic Audio Classification from Power Spectra. Pattern Recognition, 2019, 92, pp.82-92. ⟨10.1016/j.patcog.2019.03.017⟩. ⟨hal-01834221v3⟩
331 View
945 Download



Gmail Facebook Twitter LinkedIn More