End-to-End Continuous Speech Emotion Recognition in Real-life Customer Service Call Center Conversations - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

End-to-End Continuous Speech Emotion Recognition in Real-life Customer Service Call Center Conversations

Résumé

Speech Emotion recognition (SER) in call center conversations has emerged as a valuable tool for assessing the quality of interactions between clients and agents. In contrast to controlled laboratory environments, real-life conversations take place under uncontrolled conditions and are subject to contextual factors that influence the expression of emotions. In this paper, we present our approach to constructing a large-scale reallife dataset (CusEmo) for continuous SER in customer service call center conversations. We adopted the dimensional emotion annotation approach to capture the subtlety, complexity, and continuity of emotions in real-life call center conversations, while annotating contextual information. The study also addresses the challenges encountered during the application of the End-to-End (E2E) SER system to the dataset, including determining the appropriate label sampling rate and input segment length, as well as integrating contextual information (interlocutor's gender and empathy level) with different weights using multitask learning. The result shows that incorporating the empathy level information improved the model's performance.
Fichier principal
Vignette du fichier
ACIIW2023_59127.pdf (1.07 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04223196 , version 1 (29-09-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04223196 , version 1

Citer

Yajing Feng, Laurence Devillers. End-to-End Continuous Speech Emotion Recognition in Real-life Customer Service Call Center Conversations. 2023 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), Sep 2023, Boston (MA), United States. ⟨hal-04223196⟩
48 Consultations
46 Téléchargements

Partager

Gmail Facebook X LinkedIn More