Human Motions and Emotions Recognition Inspired by LMA Qualities - Archive ouverte HAL Access content directly
Journal Articles The Visual Computer Year : 2019

Human Motions and Emotions Recognition Inspired by LMA Qualities


The purpose of this paper is to describe human motions and emotions that appear on real video images with compact and informative representations. We aimed to recognize expressive motions and analyze the relationship between human body features and emotions. We propose a new descriptor vector for expressive human motions inspired from the Laban Movement Analysis method (LMA), a descriptive language with an underlying semantics that allows to qualify human motion in its different aspects. The proposed descriptor is fed into a machine learning framework including, Random Decision Forest, Multi-Layer Per-ceptron and two multiclass Support Vector Machines methods. We evaluated our descriptor first for motion recognition and second for emotion recognition from the analysis of expressive body movements. Preliminary experiments with three public datasets, MSRC-12, MSR Action 3D and UTkinect showed that our model performs better than many existing motion recognition methods. We also built a dataset composed of 10 control motions (move, turn left, turn right, stop, sit down, wave, dance, introduce yourself, increase velocity, decrease velocity). We tested our descriptor vector and I. Ajili achieved high recognition performance. In the second experimental part, we evaluated our descriptor with a dataset composed of expressive gestures performed with four basic emotions selected from Russel's Circum-plex model of affect (happy, angry, sad and calm). The same machine learning methods were used for human emotions recognition based on expressive motions. A 3D virtual avatar was introduced to reproduce human body motions, and three aspects were analyzed 1) how expressed emotions are classified by humans, 2) how motion descriptor is evaluated by humans, 3) what is the relationship between human emotions and motion features.
Fichier principal
Vignette du fichier
Visual-Computer2018_Pre-Print.pdf (1.68 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01971026 , version 1 (06-01-2019)



Insaf Ajili, Malik Mallem, Jean-Yves Didier. Human Motions and Emotions Recognition Inspired by LMA Qualities. The Visual Computer, 2019, 35, pp.1411--1426. ⟨10.1007/s00371-018-01619-w⟩. ⟨hal-01971026⟩
79 View
346 Download



Gmail Facebook Twitter LinkedIn More