3D-aided face recognition robust to expression and pose variations - Archive ouverte HAL Access content directly
Conference Papers Year : 2014

3D-aided face recognition robust to expression and pose variations


Expression and pose variations are major challenges for reliable face recognition (FR) in 2D. In this paper, we aim to endow state of the art face recognition SDKs with robustness to facial expression variations and pose changes by using an extended 3D Morphable Model (3DMM) which isolates identity variations from those due to facial expressions. Specifically, given a probe with expression, a novel view of the face is generated where the pose is rectified and the expression neutralized. We present two methods of expression neutralization. The first one uses prior knowledge to infer the neutral expression image from an input image. The second method, specifically designed for verification, is based on the transfer of the gallery face expression to the probe. Experiments using rectified and neutralized view with a standard commercial FR SDK on two 2D face databases, namely Multi-PIE and AR, show significant performance improvement of the commercial SDK to deal with expression and pose variations and demonstrates the effectiveness of the proposed approach.
No file

Dates and versions

hal-01271809 , version 1 (09-02-2016)


  • HAL Id : hal-01271809 , version 1


Baptiste Chu, Sami Romdhani, Liming Chen. 3D-aided face recognition robust to expression and pose variations. 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2014, Columbus, Ohio, United States. pp.1-8. ⟨hal-01271809⟩
105 View
0 Download


Gmail Facebook X LinkedIn More