A Hybrid Explainable AI Framework Applied to Global and Local Facial Expression Recognition - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

A Hybrid Explainable AI Framework Applied to Global and Local Facial Expression Recognition

Slavisa Jovanovic
H. Rabah

Résumé

Facial Expression Recognition (FER) systems have many applications such as human behavior understanding, human machine interface, video games and health monitoring. The main advantage of the traditional white box methods is their explainability. However, the accuracy of recognition of these methods is completely reliant on the extracted features. On the other hand, the use of deep neural networks has advantage regarding the overall precision compared to traditional methods. Indeed, they are considered as black box methods and thus suffer from lack of reliability and explainability. In this work, we introduce a hybrid AI explainable framework (HEF) composed of a main functional pipeline comprising a Convolutional Neural Network (CNN) to classify input images and an explainable pipeline using Facial Action Units and application agnostic models LIME providing more useful data allowing to explain the obtained results and reinforce the decision provided by the main functional pipeline. The proposed HEF has been validated on the CK+ dataset and shows very promising results in terms of explainability of the obtained results.

Dates et versions

hal-03981841 , version 1 (10-02-2023)

Identifiants

Citer

M. Deramgozin, Slavisa Jovanovic, H. Rabah, N. Ramzan. A Hybrid Explainable AI Framework Applied to Global and Local Facial Expression Recognition. 2021 IEEE International Conference on Imaging Systems and Techniques (IST), Aug 2021, Kaohsiung, Taiwan. pp.1-5, ⟨10.1109/IST50367.2021.9651357⟩. ⟨hal-03981841⟩
24 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More