Evaluating 3d human pose estimation in occluded multi-sensor scenarios : dataset and annotation approach - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Evaluating 3d human pose estimation in occluded multi-sensor scenarios : dataset and annotation approach

Résumé

Obtaining ground truth annotations for 3D pose estimation (3D HPE) typically depends on motion capture equipment (Mocap), which is not only expensive but impractical for widespread deployment. In contrast, triangulation can reconstruct 3D poses solely from multi-view 2D poses with known camera parameters, eliminating the need for Mocap. However, inherent noise in 2D pose predictions introduces uncertainties, compromising the reliability of the results. To obtain more reliable annotations with noisy input, we introduce an annotation approach for the 3D HPE task, driven by prior knowledge of the skeletal configuration. We split our approach into two steps: first a parametric model is designed to enhance confidence predictions. Then, a differentiable weighted triangulation is employed to estimate the 3D pose in world space, leveraging the predicted confidence scores as weights. The pipeline is trained using a bone length loss. Moreover, we collect a multi-view dataset for 3D HPE and annotate it using our proposed annotation tool. This dataset is characterized by more construction scenarios, including heavier occlusion cases, diverse viewing directions, and the integration of various optical sensors, setting it apart from existing datasets. Experiments on both our dataset and Hu-man3.6M demonstrate the effectiveness of our method.
Fichier principal
Vignette du fichier
hall_6_data-11.pdf (4.85 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04812238 , version 1 (30-11-2024)

Identifiants

Citer

Kévin Riou, Kaiwen Dong, Yujie Huang, Kévin Subrin, Patrick Le Callet, et al.. Evaluating 3d human pose estimation in occluded multi-sensor scenarios : dataset and annotation approach. 2024 IEEE International Conference on Image Processing (ICIP), Oct 2024, Abu Dhabi, France. pp.2683-2689, ⟨10.1109/ICIP51287.2024.10647858⟩. ⟨hal-04812238⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More