Time-continuous Estimation of Emotion in Music with Recurrent Neural Networks - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

Time-continuous Estimation of Emotion in Music with Recurrent Neural Networks

Résumé

In this paper, we describe the IRIT's approach used for the MediaEval 2015 "Emotion in Music" task. The goal was to predict two real-valued emotion dimensions, namely valence and arousal, in a time-continuous fashion. We chose to use recurrent neural networks (RNN) for their sequence modeling capabilities. Hyperparameter tuning was performed through a 10-fold cross-validation setup on the 431 songs of the development subset. With the baseline set of 260 acoustic features, our best system achieved averaged root mean squared errors of 0.250 and 0.238, and Pearson's correlation coefficients of 0.703 and 0.692, for valence and arousal, respectively. These results were obtained by first making predictions with an RNN comprised of only 10 hidden units, smoothed by a moving average filter, and used as input to a second RNN to generate the final predictions. This system gave our best results on the official test data subset for arousal (RMSE=0.247, r=0.588), but not for Valence. Valence predictions were much worse (RMSE=0.365, r=0.029). This may be explained by the fact that in the development subset, valence and arousal values were very correlated (r=0.626), and this was not the case with the test data. Finally, slight improvements over these figures were obtained by adding spectral atness and spectral valley features to the baseline set.
Fichier principal
Vignette du fichier
pellegrini_15436.pdf (410.32 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01327121 , version 1 (06-06-2016)

Identifiants

  • HAL Id : hal-01327121 , version 1
  • OATAO : 15436

Citer

Thomas Pellegrini, Valentin Barrière. Time-continuous Estimation of Emotion in Music with Recurrent Neural Networks. MediaEval 2015 Multimedia Benchmark Workshop (MediaEval 2015), Sep 2015, Wurzen, Germany. pp. 1-3. ⟨hal-01327121⟩
154 Consultations
113 Téléchargements

Partager

Gmail Facebook X LinkedIn More