Spatiotemporal Features Fusion From Local Facial Regions for Micro-Expressions Recognition - Archive ouverte HAL
Article Dans Une Revue Frontiers in Signal Processing Année : 2022

Spatiotemporal Features Fusion From Local Facial Regions for Micro-Expressions Recognition

Résumé

Facial micro-expressions (MiEs) analysis has applications in various fields, including emotional intelligence, psychotherapy, and police investigation. However, because MiEs are fast, subtle, and local reactions, there is a challenge for humans and machines to detect and recognize them. In this article, we propose a deep learning approach that addresses the locality and the temporal aspects of MiE by learning spatiotemporal features from local facial regions. Our proposed method is particularly unique in that we use two fusion-based squeeze and excitation (SE) strategies to drive the model to learn the optimal combination of extracted spatiotemporal features from each area. The proposed architecture enhances a previous solution of an automatic system for micro-expression recognition (MER) from local facial regions using a composite deep learning model of convolutional neural network (CNN) and long short-term memory (LSTM). Experiments on three spontaneous MiE datasets show that the proposed solution outperforms state-of-the-art approaches. Our code is presented at https://github.com/MouathAb/AnalyseMiE-CNN_LSTM_SE as an open source.
Fichier principal
Vignette du fichier
pdf (1.4 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03642325 , version 1 (06-05-2022)

Identifiants

Citer

Mouath Aouayeb, Catherine Soladie, Wassim Hamidouche, Kidiyo Kpalma, Renaud Seguier. Spatiotemporal Features Fusion From Local Facial Regions for Micro-Expressions Recognition. Frontiers in Signal Processing, 2022, 2, ⟨10.3389/frsip.2022.861469⟩. ⟨hal-03642325⟩
90 Consultations
36 Téléchargements

Altmetric

Partager

More