Tensor Decomposition and Non-linear Manifold Modeling for 3D Head Pose Estimation - Archive ouverte HAL Access content directly
Journal Articles International Journal of Computer Vision Year : 2019

Tensor Decomposition and Non-linear Manifold Modeling for 3D Head Pose Estimation

Abstract

Head pose estimation is a challenging computer vision problem with important applications in different scenarios such as human–computer interaction or face recognition. In this paper, we present a 3D head pose estimation algorithm based on non-linear manifold learning. A key feature of the proposed approach is that it allows modeling the underlying 3D manifold that results from the combination of rotation angles. To do so, we use tensor decomposition to generate separate subspaces for each variation factor and show that each of them has a clear structure that can be modeled with cosine functions from a unique shared parameter per angle. Such representation provides a deep understanding of data behavior. We show that the proposed framework can be applied to a wide variety of input features and can be used for different purposes. Firstly, we test our system on a publicly available database, which consists of 2D images and we show that the cosine functions can be used to synthesize rotated versions from an object from which we see only a 2D image at a specific angle. Further, we perform 3D head pose estimation experiments using other two types of features: automatic landmarks and histogram-based 3D descriptors. We evaluate our approach on two publicly available databases, and demonstrate that angle estimations can be performed by optimizing the combination of these cosine functions to achieve state-of-the-art performance.
Fichier principal
Vignette du fichier
3DHeapPose_IJCV2019.pdf (3.15 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02267568 , version 1 (19-08-2019)

Identifiers

Cite

Dmytro Derkach, Adrià Ruiz, Federico M Sukno. Tensor Decomposition and Non-linear Manifold Modeling for 3D Head Pose Estimation. International Journal of Computer Vision, 2019, 127 (10), pp.1565-1585. ⟨10.1007/s11263-019-01208-x⟩. ⟨hal-02267568⟩
106 View
221 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More