Enhancing Speech Emotions Recognition Using Multivariate Functional Data Analysis - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Big Data and Cognitive Computing Année : 2023

Enhancing Speech Emotions Recognition Using Multivariate Functional Data Analysis

Matthieu Saumard

Résumé

Speech Emotions Recognition (SER) has gained significant attention in the fields of humancomputer interaction and speech processing. In this article, we present a novel approach to improve SER performance by interpreting the Mel Frequency Cepstral Coefficients (MFCC) as a multivariate functional data object, which accelerates learning while maintaining high accuracy. To treat MFCCs as functional data, we preprocess them as images and apply resizing techniques. By representing MFCCs as functional data, we leverage the temporal dynamics of speech, capturing essential emotional cues more effectively. Consequently, this enhancement significantly contributes to the learning process of SER methods without compromising performance. Subsequently, we employ a supervised learning model, specifically a functional Support Vector Machine (SVM), directly on the MFCC represented as functional data. This enables the utilization of the full functional information, allowing for more accurate emotion recognition. The proposed approach is rigorously evaluated on two distinct databases, EMO-DB and IEMOCAP, serving as benchmarks for SER evaluation. Our method demonstrates competitive results in terms of accuracy, showcasing its effectiveness in emotion recognition. Furthermore, our approach significantly reduces the learning time, making it computationally efficient and practical for real-world applications. In conclusion, our novel approach of treating MFCCs as multivariate functional data objects exhibits superior performance in SER tasks, delivering both improved accuracy and substantial time savings during the learning process. This advancement holds great potential for enhancing human-computer interaction and enabling more sophisticated emotion-aware applications.
Fichier principal
Vignette du fichier
BDCC-07-00146.pdf (812.42 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Licence : CC BY - Paternité

Dates et versions

hal-04189098 , version 1 (28-08-2023)

Licence

Paternité

Identifiants

Citer

Matthieu Saumard. Enhancing Speech Emotions Recognition Using Multivariate Functional Data Analysis. Big Data and Cognitive Computing, 2023, 7 (3), pp.146. ⟨10.3390/bdcc7030146⟩. ⟨hal-04189098⟩
28 Consultations
6 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More