Fine-grained facial landmark detection exploiting intermediate feature representations - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Computer Vision and Image Understanding Année : 2020

Fine-grained facial landmark detection exploiting intermediate feature representations

Résumé

Facial landmark detection has been an active research subject over the last decade. In this paper, we present a new approach for Fine-grained Facial Landmark Detection (FFLD) improving on the precision of the detected points. A high spatial precision of facial landmarks is crucial for many applications related to aesthetic rendering, such as face modeling, face animation, virtual make-up, etc. In this paper, we present an approach that improves the detection precision. Since most facial landmarks are positioned on visible boundary lines, we train a model that encourages the detected landmarks to stay on these boundaries. Our proposed Convolutional Neural Networks (CNN) effectively exploits lower-level feature maps containing abundant boundary information. To this end, beside the main CNN predicting facial landmark positions, we use several additional components, called CropNets. CropNet receives patches cropped from feature maps at different stages of this CNN, and estimate fine corrections of its predicted positions. We also introduce a novel robust spatial loss function based on pixel-wise differences between patches cropped from predicted and ground-truth positions. To further improve the landmark localisation, our framework uses several loss functions optimising the precision at several stages in different ways. Extensive experiments show that our framework significantly increases the local precision of state-of-the-art deep coordinate regression models.
Fichier principal
Vignette du fichier
CVIU_Fine_grained_facial_landmark_detection_exploiting_intermediate_feature_representations.pdf (44.11 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02890931 , version 1 (06-07-2020)

Identifiants

Citer

Yongzhe Yan, Stefan Duffner, Priyanka Phutane, Anthony Berthelier, Xavier Naturel, et al.. Fine-grained facial landmark detection exploiting intermediate feature representations. Computer Vision and Image Understanding, In press, 200, pp.1-14. ⟨10.1016/j.cviu.2020.103036⟩. ⟨hal-02890931⟩
111 Consultations
50 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More