Towards Pose-free Tracking of Non-rigid Face using Synthetic Data - Archive ouverte HAL Access content directly
Conference Papers Year : 2015

Towards Pose-free Tracking of Non-rigid Face using Synthetic Data


The non-rigid face tracking has been achieved many advances in recent years, but most of empirical experiments are restricted at near-frontal face. This report introduces a robust framework for pose-free tracking of non-rigid face. Our method consists of two phases: training and tracking. In the training phase, a large offline synthesized database is built to train landmark appearance models using linear Support Vector Machine (SVM). In the tracking phase, a two-step approach is proposed: the first step, namely initialization, benefits 2D SIFT matching between the current frame and a set of adaptive keyframes to estimate the rigid parameters. The second step obtains the whole set of parameters (rigid and non-rigid) using a heuristic method via pose-wise SVMs. The combination of these aspects makes our method work robustly up to 90 degree of vertical axial rotation. Moreover, our method appears to be robust even in the presence of fast movements and tracking losses. Comparing to other published algorithms, our method offers a very good compromise of rigid and non-rigid parameter accuracies. This study gives a promising perspective because of the good results in terms of pose estimation (average error is less than 4 o on BUFT dataset) and landmark tracking precision (5.8 pixel error compared to 6.8 of one state-of-the-art method on Talking Face video). These results highlight the potential of using synthetic data to track non-rigid face in unconstrained poses.
Fichier principal
Vignette du fichier
icpram2015.pdf (2.3 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01166778 , version 1 (23-06-2015)



Ngoc-Trung Tran, Fakhreddine Ababsa, Maurice Charbit. Towards Pose-free Tracking of Non-rigid Face using Synthetic Data. 2015 International Conference on Pattern Recognition Applications and Methods (ICPRAM 2015), Jan 2015, Lisbon, Portugal. ⟨10.5220/0005179300370044⟩. ⟨hal-01166778⟩
371 View
173 Download



Gmail Facebook X LinkedIn More