mlsanityData to 7 Oct 2026

A survey and classification of face alignment methods based on face models

arXiv 2311.03082 ↗First posted 6 Nov 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

A face model is a mathematical representation of the distinct features of a human face. Traditionally, face models were built using a set of fiducial points or landmarks, each point ideally located on a facial feature, i.e., corner of the eye, tip of the nose, etc. Face alignment is the process of fitting the landmarks in a face model to the respective ground truth positions in an input image containing a face. Despite significant research on face alignment in the past decades, no review analyses various face models used in the literature. Catering to three types of readers - beginners, practitioners and researchers in face alignment, we provide a comprehensive analysis of different face models used for face alignment. We include the interpretation and training of the face models along with the examples of fitting the face model to a new face image. We found that 3D-based face models are preferred in cases of extreme face pose, whereas deep learning-based methods often use heatmaps. Moreover, we discuss the possible future directions of face models in the field of face alignment.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 95 references that are in the map. First posted on arXiv 6 Nov 2023.

Builds on

34 of 95 references.

References · 34

  1. 2016Stacked Hourglass Networks for Human Pose Estimationcited by 913
  2. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  3. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
  4. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  5. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  6. 20193D Morphable Face Models -- Past, Present and Futurecited by 269
  7. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  8. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  9. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  10. 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
  11. 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
  12. 2018Face Alignment in Full Pose Range: A 3D Total Solutioncited by 147
22 more
  1. 2019Adaptive Wing Loss for Robust Face Alignment via Heatmap Regressioncited by 127
  2. 2018Unsupervised Training for 3D Morphable Model Regressioncited by 99
  3. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  4. 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
  5. 2019Towards High-fidelity Nonlinear 3D Face Morphable Modelcited by 91
  6. 2018On Learning 3D Face Morphable Model from In-the-wild Imagescited by 54
  7. 2016Human pose estimation via Convolutional Part Heatmap Regressioncited by 51
  8. 2017Deep Alignment Network: A convolutional neural network for robust face alignmentcited by 44
  9. 2018Jointly Optimize Data Augmentation and Network Training: Adversarial Data Augmentation in Human Pose Estimationcited by 44
  10. 2021Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial Geometrycited by 27
  11. 2018Evaluation of Dense 3D Reconstruction from 2D Face Images in the Wildcited by 22
  12. 2018Towards Highly Accurate and Stable Face Alignment for High-Resolution Videoscited by 19
  13. 2021HIH: Towards More Accurate Face Alignment via Heatmap in Heatmapcited by 15
  14. 2017Pose-Invariant Face Alignment with a Single CNNcited by 11
  15. 2015Pose-Invariant 3D Face Alignmentcited by 8
  16. 2016Two-stage Convolutional Part Heatmap Regression for the 1st 3D Face Alignment in the Wild (3DFAW) Challengecited by 8
  17. 2018Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognitioncited by 7
  18. 20193D Face Reconstruction from A Single Image Assisted by 2D Face Images in the Wildcited by 7
  19. 2016Face Alignment In-the-Wild: A Surveycited by 6
  20. 2019Dual Attention MobDenseNet(DAMDNet) for Robust 3D Face Alignmentcited by 6
  21. 2023RAFaRe: Learning Robust and Accurate Non-parametric 3D Face Reconstruction from Pseudo 2D&3D Pairscited by 6
  22. 20173D Face Reconstruction from Light Field Images: A Model-free Approachcited by 5

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.

  1. 2023Deep Learning Approaches for Seizure Video Analysis: A Reviewcited by 6