Conference Papers Year : 2024

PhysioFormer: A Spatio-Temporal Transformer for Physical Rehabilitation Assessment

Abstract

Studies indicate that physical rehabilitation exercises recommended by healthcare professionals can enhance physical function, improve quality of life, and promote independence for physically disabled individuals. In response to the lack of immediate expert feedback on performed actions, developing an automated system for monitoring such actions and providing feedback is very much needed. In this work, we focus on skeleton-based exercise assessment, which uses skeleton data to evaluate human motion and provide a score on how well a patient performed a movement. There are several approaches to this issue, with Spatio Temporal Graph Convolutional Networks (GCN) being among the most recent. GCNs model skeleton data as graphs and utilize temporal and spatial convolutions to capture relationships between joints more effectively than previous methods. In this research, we propose a new Transformer based model, PhysioFormer. It is inspired by Skate-Former method for human action recognition, with enhanced structure to fit the task of physical rehabilitation assessment. The model leverages skeletal-temporal self-attention across different groups based on relations between joints. The evaluation is done on the KIMORE, UI-PRMD, and KERAAL datasets, benchmark datasets that provide skeleton data captured by Kinect motion system. Our model is surpassing state-of-the-art methods significantly.
Fichier principal
Vignette du fichier
Marusic2024I.pdf (432.67 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04857956 , version 1 (29-12-2024)

Licence

Identifiers

Cite

Aleksa Marusic, Sao Mai Nguyen, Adriana Tapus. PhysioFormer: A Spatio-Temporal Transformer for Physical Rehabilitation Assessment. ICSR 2024 - 16th International Conference on Social Robotics, Oct 2024, Odense, Denmark. ⟨10.1145/3568294.3580153⟩. ⟨hal-04857956⟩
25 View
24 Download

Altmetric

Share

More