Communication Dans Un Congrès Année : 2025

Evaluating Automatic Hand-Gesture Generation Using Multimodal Corpus Annotations: The Benefits of a Multidisciplinary Approach

Résumé

This exploratory study addresses the challenges of evaluating the quality of hand-gesture synthesis. It introduces an interdisciplinary methodology aimed at providing objective evaluation criteria. The study examines expert annotations applied on a small dataset combining both natural and synthetic gestures, showing how their comparison can reveal key indicators for assessing communicative efficiency and adequate movement dynamics. Communicative gestures are more frequent, shorter, and easier to interpret in natural data, while synthetic gestures are more ambiguous, with less precise annotations and less consistent velocity profiles. These findings support the idea that only an interdisciplinary approach -combining computational modeling with insights from gesture studies in the language sciences-can yield meaningful criteria for evaluating and ultimately improving the quality of synthesized gestures.

Fichier principal
Vignette du fichier
genea_article.pdf (1.45 Mo) Télécharger le fichier
pres_GENEA_2025.pdf (1.39 Mo) Télécharger le fichier

Dates et versions

hal-05330689 , version 1 (24-10-2025)

Licence

Identifiants

Citer

Mickaëlla Grondin-Verdon, Domitille Caillat, Louis Abel, Slim Ouni. Evaluating Automatic Hand-Gesture Generation Using Multimodal Corpus Annotations: The Benefits of a Multidisciplinary Approach. MM '25:The 33rd ACM International Conference on Multimedia, Taras Kucherenko; Laura B. Hensel, Oct 2025, Dublin, Ireland. pp.3-11, ⟨10.1145/3746268.3759430⟩. ⟨hal-05330689⟩
423 Consultations
314 Téléchargements

Altmetric

Partager

  • More