Fine-grained facial landmark detection exploiting intermediate feature representations - Archive ouverte HAL Access content directly
Journal Articles Computer Vision and Image Understanding Year : 2020

Fine-grained facial landmark detection exploiting intermediate feature representations


Facial landmark detection has been an active research subject over the last decade. In this paper, we present a new approach for Fine-grained Facial Landmark Detection (FFLD) improving on the precision of the detected points. A high spatial precision of facial landmarks is crucial for many applications related to aesthetic rendering, such as face modeling, face animation, virtual make-up, etc. In this paper, we present an approach that improves the detection precision. Since most facial landmarks are positioned on visible boundary lines, we train a model that encourages the detected landmarks to stay on these boundaries. Our proposed Convolutional Neural Networks (CNN) effectively exploits lower-level feature maps containing abundant boundary information. To this end, beside the main CNN predicting facial landmark positions, we use several additional components, called CropNets. CropNet receives patches cropped from feature maps at different stages of this CNN, and estimate fine corrections of its predicted positions. We also introduce a novel robust spatial loss function based on pixel-wise differences between patches cropped from predicted and ground-truth positions. To further improve the landmark localisation, our framework uses several loss functions optimising the precision at several stages in different ways. Extensive experiments show that our framework significantly increases the local precision of state-of-the-art deep coordinate regression models.
Fichier principal
Vignette du fichier
CVIU_Fine_grained_facial_landmark_detection_exploiting_intermediate_feature_representations.pdf (44.11 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02890931 , version 1 (06-07-2020)



Yongzhe Yan, Stefan Duffner, Priyanka Phutane, Anthony Berthelier, Xavier Naturel, et al.. Fine-grained facial landmark detection exploiting intermediate feature representations. Computer Vision and Image Understanding, inPress, 200, pp.1-14. ⟨10.1016/j.cviu.2020.103036⟩. ⟨hal-02890931⟩
103 View
46 Download



Gmail Facebook Twitter LinkedIn More