3D Deformable Super-Resolution For Multi-Camera 3D Face Scanning
Résumé
Low-cost and high-accuracy 3D face measurement
is becoming increasingly important in many computer vision
applications including face recognition, facial animation,
games, orthodontics and aesthetic surgery. In most cases
fringe projection based systems are used to overcome the
relatively uniform appearance of skin. These systems employ
a structured light camera/projector device and require
explicit user cooperation and controlled lighting conditions.
In this paper, we propose a 3D acquisition solution with a
3D space-time non-rigid super-resolution capability, using
three calibrated cameras coupled with a non calibrated projector
device, which is particularly suited to 3D face scanning,
i.e. rapid, easily movable and robust to ambient lighting
variation. The proposed solution is a hybrid stereovision
and phase-shifting approach, using two shifted patterns and
a texture image, which not only takes advantage of stereovision
and structured light, but also overcomes their weaknesses.
The super-resolution scheme involves a shape+texture
3D non-rigid registration for 3D artifacts correction in the
presence of small non-rigid deformations as facial expressions.