Evaluating the impact of multiscale temporal processing on sound-to-event recurrent neural networks - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Evaluating the impact of multiscale temporal processing on sound-to-event recurrent neural networks

Michele Esposito
  • Fonction : Auteur
  • PersonId : 1426290
Bruno L Giordano
Giancarlo Valente
  • Fonction : Auteur
  • PersonId : 1426291
Elia Formisano
  • Fonction : Auteur
  • PersonId : 1426198

Résumé

This study investigates the impact of multiscale temporal processing on environmental sound recognition using deep neural networks (DNN). Inspired by the brain's capability to process auditory information across various time scales, we developed a multi-scale DNN architecture, integrating multiple parallel recurrent neural network (RNN) streams. Each stream processes the input spectrogram at a distinct temporal scale. The outputs of these streams are then combined and further processed to achieve sound categorization with a temporal resolution of 50 ms. This design aims to capture the diverse dynamics of natural sounds at large, ranging from transient, impulsive signals to repetitive and sustained sounds. We conducted a comparative analysis between the performance of this multiscale RNN network and networks trained on single-scale inputs. A comparison of our multiscale RNN network with single-scale networks reveals superior multiscale-RNN recognition of events. This performance advantage suggests that the combination of the unique information in multiple temporal scales achieves superior classification of natural sound events.
Fichier principal
Vignette du fichier
ME_2024_CCN2024.pdf (381.1 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04732884 , version 1 (11-10-2024)

Identifiants

  • HAL Id : hal-04732884 , version 1

Citer

Michele Esposito, Bruno L Giordano, Giancarlo Valente, Elia Formisano. Evaluating the impact of multiscale temporal processing on sound-to-event recurrent neural networks. 2024 Conference on Cognitive Computational Neuroscience, 2024, Boston (MA), United States. ⟨hal-04732884⟩
46 Consultations
8 Téléchargements

Partager

More