Describing movement learning using metric learning - Archive ouverte HAL Access content directly
Journal Articles PLoS ONE Year : 2023

Describing movement learning using metric learning


Analysing movement learning can rely on human evaluation, e.g. annotating video recordings, or on computing means in applying metrics on behavioural data. However, it remains challenging to relate human perception of movement similarity to computational measures that aim at modelling such similarity. In this paper, we propose a metric learning method bridging the gap between human ratings of movement similarity in a motor learning task and computational metric evaluation on the same task. It applies metric learning on a Dynamic Time Warping algorithm to derive an optimal set of movement features that best explain human ratings. We evaluated this method on an existing movement dataset, which comprises videos of participants practising a complex gesture sequence toward a target template, as well as the collected data that describes the movements. We show that it is possible to establish a linear relationship between human ratings and our learned computational metric. This learned metric can be used to describe the most salient temporal moments implicitly used by annotators, as well as movement parameters that correlate with motor improvements in the dataset. We conclude with possibilities to generalise this method for designing computational tools dedicated to movement annotation and evaluation of skill learning.
Fichier principal
Vignette du fichier
PLOS___motor_metric_learning___manuscript__revised___final_.pdf (1.1 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03790829 , version 1 (28-09-2022)





Antoine Loriette, Wanyu Liu, Frédéric Bevilacqua, Baptiste Caramiaux. Describing movement learning using metric learning. PLoS ONE, 2023, Plos ONE, 18 (2), ⟨10.1371/journal.pone.0272509⟩. ⟨hal-03790829⟩
89 View
61 Download



Gmail Facebook X LinkedIn More