Automatic facial expression recognition based on spatiotemporal descriptors - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Pattern Recognition Letters Année : 2012

Automatic facial expression recognition based on spatiotemporal descriptors

Yi Ji
  • Fonction : Auteur

Résumé

Facial expression’s machine analysis is one of the most challenging problems in Human–Computer Interaction (HCI). Naturally, facial expressions depend on subtle movements of facial muscles to show emotional states. After having studied the relations between basic expressions and corresponding facial deformation models, we propose two new textons, VTB and moments on spatiotemporal plane, to describe the transformation of human face during facial expressions. These descriptors aim at catching both general shape changes and motion texture details. Therefore, modelling the temporal behaviour of facial expression captures the dynamic deformation of facial components. Finally, SVM based system is used to efficiently recognize the expression for a single image in sequence. Then, the probabilities of all the frames are used to predict the class of the current sequence. The experimental results are evaluated on both Cohan–Kanade and MMI databases. By comparison to other methods, the effectiveness of our method is clearly demonstrated

Dates et versions

hal-01352988 , version 1 (10-08-2016)

Identifiants

Citer

Yi Ji, Khalid Idrissi. Automatic facial expression recognition based on spatiotemporal descriptors. Pattern Recognition Letters, 2012, 10, 33, pp.1373-1380. ⟨10.1016/j.patrec.2012.03.006⟩. ⟨hal-01352988⟩
132 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More