CGCNN: COMPLEX GABOR CONVOLUTIONAL NEURAL NETWORK ON RAW SPEECH - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

CGCNN: COMPLEX GABOR CONVOLUTIONAL NEURAL NETWORK ON RAW SPEECH

Mohamed Morchid

Résumé

Convolutional Neural Networks (CNN) have been used in Automatic Speech Recognition (ASR) to learn representations directly from the raw signal instead of hand-crafted acoustic features, providing a richer and lossless input signal. Recent researches propose to inject prior acoustic knowledge to the first convolutional layer by integrating the shape of the impulse responses in order to increase both the interpretability of the learnt acoustic model, and its performances. We propose to combine the complex Gabor filter with complex-valued deep neural networks to replace usual CNN weights kernels, to fully take advantage of its optimal time-frequency resolution and of the complex domain. The conducted experiments on the TIMIT phoneme recognition task shows that the proposed approach reaches top-of-the-line performances while remaining interpretable.
Fichier principal
Vignette du fichier
gabor_complex_cnn_final.pdf (317.03 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02474746 , version 1 (11-02-2020)

Identifiants

  • HAL Id : hal-02474746 , version 1

Citer

Paul-Gauthier Noé, Titouan Parcollet, Mohamed Morchid. CGCNN: COMPLEX GABOR CONVOLUTIONAL NEURAL NETWORK ON RAW SPEECH. ICASSP 2020, May 2020, Barcelona, Spain. ⟨hal-02474746⟩

Collections

UNIV-AVIGNON LIA
245 Consultations
232 Téléchargements

Partager

Gmail Facebook X LinkedIn More