Attention-Enabled Lightweight Neural Network Architecture for Detection of Action Unit Activation - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Access Année : 2023

Attention-Enabled Lightweight Neural Network Architecture for Detection of Action Unit Activation

Mohammad Mahdi Deramgoz
Slavisa Jovanov
Miguel Arevalilloherráe
Naeem Ramzan
Hassan Rabah
Connectez-vous pour contacter l'auteur

Résumé

Facial Action Unit (AU) detection is of major importance in a broad range of artificial intelligence applications such as healthcare, Facial Expression Recognition (FER), and mental state analysis. In this paper, we present an innovative, resource-efficient facial AU detection model, embedding both spatial and channel attention mechanisms into a convolutional neural network (CNN). Along with a unique data input system leveraging image data and binary-encoded AU activation labels, our model enhances AU detection capabilities while simultaneously offering interpretability for FER systems. In contrast to existing state-of-the-art models, our proposal's streamlined architecture, combined with superior performance, establishes it as an ideal solution for resource-limited environments like mobile and embedded systems with computational constraints. The model was trained and evaluated utilizing the BP4D, CK+, DISFA, FER2013+, and RAF-DB datasets, with the latter two being particularly significant as they represent wild datasets for facial expression recognition. These datasets encompass ground truth emotions matched with corresponding AU activations according to the Facial Action Coding System. Various metrics, including F1 score, accuracy, and Euclidean distance, showcase its effectiveness in AU detection and interpretability. INDEX TERMS Facial action unit detection, lightweight AU detection, attention mechanism, convolutional neural networks (CNN), eXplainable artificial intelligence (XAI), eXplainable FER system.
Fichier principal
Vignette du fichier
Attention-Enabled_Lightweight_Neural_Network_Architecture_for_Detection_of_Action_Unit_Activation.pdf (3.08 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04451576 , version 1 (11-02-2024)

Licence

Identifiants

Citer

Mohammad Mahdi Deramgoz, Slavisa Jovanov, Miguel Arevalilloherráe, Naeem Ramzan, Hassan Rabah. Attention-Enabled Lightweight Neural Network Architecture for Detection of Action Unit Activation. IEEE Access, 2023, 11, pp.117954-117970. ⟨10.1109/ACCESS.2023.3325034⟩. ⟨hal-04451576⟩
48 Consultations
27 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More