Multitask Metamodel for Keypoint Visibility Prediction in Human Pose Estimation - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

Multitask Metamodel for Keypoint Visibility Prediction in Human Pose Estimation

Résumé

The task of human pose estimation (HPE) aims to predict the coordinates of body keypoints in images. Even if nowadays, we achieve high performance on HPE, some difficulties remain to be fully overcome. For instance, a strong occlusion can deceive the methods and make them predict false-positive keypoints with high confidence. This can be problematic in applications that require reliable detection, such as posture analysis in car-safety applications. Despite this difficulty, actual HPE solutions are designed to always predict coordinates for each keypoint. To answer this problem, we propose a new metamodel that predicts both keypoints coordinates and their visibility. Visibility is an attribute that indicates if a keypoint is visible, non-visible, or not labeled. Our model is composed of three modules: the feature extraction, the coordinate estimation, and the visibility prediction modules. We study in this paper the performance of the visibility predictions and the impact of this task on the coordinate estimation. Baseline results are provided on the COCO dataset. Moreover, to measure the performance of this method in a more occluded context, we also use the driver dataset DriPE. Finally, we implement the proposed metamodel on several base models to demonstrate the general aspect of our metamodel.
Fichier principal
Vignette du fichier
Vis_2D_HAL.pdf (4.82 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03471147 , version 1 (08-12-2021)

Identifiants

Citer

Romain Guesdon, Carlos F Crispim-Junior, Laure Tougne. Multitask Metamodel for Keypoint Visibility Prediction in Human Pose Estimation. International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP), Feb 2022, Virtual Conference, France. ⟨10.5220/0010831200003124⟩. ⟨hal-03471147⟩
229 Consultations
336 Téléchargements

Altmetric

Partager

More