Speech emotion recognition using GhostVLAD and sentiment metric learning - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Speech emotion recognition using GhostVLAD and sentiment metric learning

Résumé

In this paper, we introduce a novel deep learning-based speech emotion recognition method. The proposed approach exploits a convolutional neural network (CNN), enriched with a GhostVLAD feature aggregation layer. The resulting representation adjusts the contribution of each spectrogram segments to the final class prototype representation and is used for trainable and discriminative clustering purposes. In addition, we introduce a modified triplet loss function which integrates the relations between the various emotional patterns. The experimental evaluation, carried out on RAVDESS and CREMA-D datasets validates the proposed methodology, which yields emotion recognition rates superior to 83% and 64%, respectively. The comparative evaluation shows that the proposed approach outperforms state of the art techniques, with gains in accuracy of more than 3%.
Fichier non déposé

Dates et versions

hal-03590987 , version 1 (28-02-2022)

Identifiants

Citer

Bogdan Mocanu, Ruxandra Tapu. Speech emotion recognition using GhostVLAD and sentiment metric learning. ISPA 2021: 12th international symposium on Image and Signal Processing and Analysis, Sep 2021, Zagreb (online), Croatia. pp.126-130, ⟨10.1109/ISPA52656.2021.9552068⟩. ⟨hal-03590987⟩
22 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More