A Dataset of Gaze and Mouse Patterns in the Context of Facial Expression Recognition - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

A Dataset of Gaze and Mouse Patterns in the Context of Facial Expression Recognition

Résumé

Facial expression recognition is an important and challenging task for both the computer vision and affective computing communities, and even more specifically in the context of multimedia applications, where audience understanding is of particular interest. Recent data-oriented approaches have created the need for large-scale annotated datasets. However, most existing datasets present some weaknesses, because of the collecting methods used. In order to further highlight these issues, we investigate in this work how human visual attention is deployed when performing a facial expression recognition task. To do so, we carried out several complementary experiments, using the eye-tracking technology, as well as the BubbleView metaphor, both under laboratory and crowdsourcing settings. We show significant variations in gaze patterns depending on the emotion represented, but also on the difficulty of the task, i.e., whether the emotion is correctly recognised or not. Moreover, we use these results to propose recommendations on the ways to collect label data for facial expression recognition datasets.
Fichier principal
Vignette du fichier
2023 BRUCKERT (ACM IMX denfer).pdf (3.96 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : Domaine public

Dates et versions

hal-04056026 , version 1 (03-04-2023)

Identifiants

  • HAL Id : hal-04056026 , version 1

Citer

Alexandre Bruckert, Lucie Lévêque, Matthieu Perreira Da Silva, Patrick Le Callet. A Dataset of Gaze and Mouse Patterns in the Context of Facial Expression Recognition. ACM International Conference on Interactive Media Experiences (IMX), Jun 2023, Nantes, France. ⟨hal-04056026⟩
78 Consultations
45 Téléchargements

Partager

Gmail Facebook X LinkedIn More