A Dual Perspective of Human Motion Analysis -3D Pose Estimation and 2D Trajectory Prediction - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

A Dual Perspective of Human Motion Analysis -3D Pose Estimation and 2D Trajectory Prediction

Résumé

Anticipating human motion based on given sequences is a challenging and crucial task in computer vision and machine learning, enabling machines to understand human behaviors effectively. Precise prediction of human pose and motion trajectory holds great significance for various applications, including autonomous driving, robotics, and virtual reality. This paper presents a novel approach to address the interconnected tasks of estimating human motion, represented as 3D poses or 2D trajectories, and predicting future motions using 2D images and human pose/position sequences jointly. We propose an encoder-decoder architecture that leverages Transformer networks with a selfattention mechanism, utilizing visual context features, combined with an LSTM to model human motion kinematics. Our approach demonstrates consistent and remarkable improvements over existing methods, both quantitatively and qualitatively. Extensive experiments conducted on diverse public datasets, such as GTA-IM and PROX for 3D human pose estimation, and ETH and UCY combined datasets for 2D trajectory prediction, showcase that our method substantially reduces prediction errors compared to the current state-of-the-art methods.
Fichier principal
Vignette du fichier
JRDB2023_CameraReady_21.pdf (1.53 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04448862 , version 1 (09-02-2024)

Identifiants

Citer

Mayssa Zaier, Hazem Wannous, Hassen Drira, Jacques Boonaert. A Dual Perspective of Human Motion Analysis -3D Pose Estimation and 2D Trajectory Prediction. 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), Oct 2023, Paris, France. pp.2181-2191, ⟨10.1109/ICCVW60793.2023.00233⟩. ⟨hal-04448862⟩
24 Consultations
33 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More