Tensor Decomposition and Non-linear Manifold Modeling for 3D Head Pose Estimation - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Journal of Computer Vision Année : 2019

Tensor Decomposition and Non-linear Manifold Modeling for 3D Head Pose Estimation

Résumé

Head pose estimation is a challenging computer vision problem with important applications in different scenarios such as human–computer interaction or face recognition. In this paper, we present a 3D head pose estimation algorithm based on non-linear manifold learning. A key feature of the proposed approach is that it allows modeling the underlying 3D manifold that results from the combination of rotation angles. To do so, we use tensor decomposition to generate separate subspaces for each variation factor and show that each of them has a clear structure that can be modeled with cosine functions from a unique shared parameter per angle. Such representation provides a deep understanding of data behavior. We show that the proposed framework can be applied to a wide variety of input features and can be used for different purposes. Firstly, we test our system on a publicly available database, which consists of 2D images and we show that the cosine functions can be used to synthesize rotated versions from an object from which we see only a 2D image at a specific angle. Further, we perform 3D head pose estimation experiments using other two types of features: automatic landmarks and histogram-based 3D descriptors. We evaluate our approach on two publicly available databases, and demonstrate that angle estimations can be performed by optimizing the combination of these cosine functions to achieve state-of-the-art performance.
Fichier principal
Vignette du fichier
3DHeapPose_IJCV2019.pdf (3.15 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02267568 , version 1 (19-08-2019)

Identifiants

Citer

Dmytro Derkach, Adrià Ruiz, Federico M Sukno. Tensor Decomposition and Non-linear Manifold Modeling for 3D Head Pose Estimation. International Journal of Computer Vision, 2019, 127 (10), pp.1565-1585. ⟨10.1007/s11263-019-01208-x⟩. ⟨hal-02267568⟩
105 Consultations
211 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More