Spectral trancoder : using pretrained urban sound classifiers on undersampled spectral representations - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Spectral trancoder : using pretrained urban sound classifiers on undersampled spectral representations

Résumé

Slow or fast third-octave bands representations (with a frame resp. every 1-s and 125-ms) have been a de facto standard for urban acoustics, used for example in long-term monitoring applications. It has the advantages of requiring few storage capabilities and of preserving privacy. As most audio classification algorithms take Mel spectral representations with very fast time weighting (ex. 10ms) as input, very few studies have tackled classification tasks using other kinds of spectral representations of audio such as slow or fast third-octave spectra. In this paper, we present a convolutional neural network architecture for transcoding fast third-octave spectrograms into Mel spectrograms, so that it could be used as input for robust pre-trained models such as YAMNet or PANN models. Compared to training a model that would take fast third-octave spectrograms as input, this approach is more effective and requires less training effort. Even if a fast third-octave spectrogram is less precise both on time and frequency dimensions, experiments show that the proposed method still allows for classification accuracy of 62.4% on UrbanSound8k and 0.44 macro AUPRC on SONYC-UST.
Fichier principal
Vignette du fichier
DCASE_2023___spectral_transcoder_camera_ready_14082023.pdf (332.33 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04178197 , version 1 (07-08-2023)
hal-04178197 , version 2 (15-08-2023)

Licence

Identifiants

  • HAL Id : hal-04178197 , version 2

Citer

Modan Tailleur, Mathieu Lagrange, Pierre Aumond, Vincent Tourre. Spectral trancoder : using pretrained urban sound classifiers on undersampled spectral representations. 8th Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE), Sep 2023, Tampere & online, Finland. ⟨hal-04178197v2⟩
161 Consultations
236 Téléchargements

Partager

More