Modelling Sentiment Analysis scores and acoustic features of emotional speech with neural networks: A pilot study - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2019

Modelling Sentiment Analysis scores and acoustic features of emotional speech with neural networks: A pilot study

Enrico Zovato
  • Fonction : Auteur
Vito Quinci
  • Fonction : Auteur
Paolo Mairano

Résumé

Abundant literature has shown that emotional speech is characterized by various acoustic cues. However, most studies focused on sentences produced by actors, disregarding more naturally produced speech due to the difficulty in finding suitable emotional data. In our previous work we had performed an analysis of audiobook data in order to see if sentiment analysis could be of help in selecting emotional sentences from read speech. A regression analysis with Linear Mixed Models had revealed small effects, and the power of the models was low. We propose here an analysis with a neural network classifier predicting sentiment on the basis of acoustic cues, given the success of such models in the speech literature. However, the accuracy of the output was merely +0.13 above chance levels, suggesting that the different components used to express emotions (acoustic and lexical) tend to be complementary rather than additive, at least in audiobooks.
Fichier non déposé

Dates et versions

hal-04259687 , version 1 (26-10-2023)

Identifiants

Citer

Enrico Zovato, Vito Quinci, Paolo Mairano. Modelling Sentiment Analysis scores and acoustic features of emotional speech with neural networks: A pilot study. Duccio Piccardi, Fabio Ardolino, Silvia Calamai. Audio archives at the crossroads of speech sciences, digital humanities and digital heritage, 6, Officinaventuno, pp.407-416, 2019, 978-88-97657-38-5. ⟨10.17469/O2106AISV000023⟩. ⟨hal-04259687⟩
10 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More