Deep Learning for Image Memorability Prediction : the Emotional Bias - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

Deep Learning for Image Memorability Prediction : the Emotional Bias

Résumé

Image memorability prediction is a recent topic in computer science. First attempts have shown that it is possible to computationally infer from the intrinsic properties of an image the extent to which it is memorable. In this paper, we introduce a fine-tuned deep learning-based computational model for image memorability prediction. The performance of this model significantly outperforms previous work and obtains a 32.78% relative increase compared to the best-performing model from the state of the art on the same dataset. We also investigate how our model generalizes on a new dataset of 150 images, for which memorability and affective scores were collected from 50 participants. The prediction performance is weaker on this new dataset, which highlights the issue of representativity of the datasets. In particular, the model obtains a higher predictive performance for arousing negative pictures than for neutral or arousing positive ones, recalling how important it is for a memorability dataset to consist of images that are appropriately distributed within the emotional space.
Fichier principal
Vignette du fichier
ACMM_paper_lastV.pdf (297.62 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01438323 , version 1 (17-01-2017)

Identifiants

Citer

Yoann Baveye, Romain Cohendet, Matthieu Perreira da Silva, Patrick Le Callet. Deep Learning for Image Memorability Prediction : the Emotional Bias. ACM Multimedia 2016, Oct 2016, Amsterdam, Netherlands. pp.491 - 495, ⟨10.1145/2964284.2967269⟩. ⟨hal-01438323⟩
367 Consultations
1187 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More