mlsanityData to 7 Oct 2026

Perspective Reconstruction of Human Faces by Joint Mesh and Landmark Regression

arXiv 2208.07142 ↗First posted 15 Aug 2022cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Even though 3D face reconstruction has achieved impressive progress, most orthogonal projection-based face reconstruction methods can not achieve accurate and consistent reconstruction results when the face is very close to the camera due to the distortion under the perspective projection. In this paper, we propose to simultaneously reconstruct 3D face mesh in the world space and predict 2D face landmarks on the image plane to address the problem of perspective 3D face reconstruction. Based on the predicted 3D vertices and 2D landmarks, the 6DoF (6 Degrees of Freedom) face pose can be easily estimated by the PnP solver to represent perspective projection. Our approach achieves 1st place on the leader-board of the ECCV 2022 WCPA challenge and our model is visually robust under different identities, expressions and poses. The training code and models are released to facilitate future research.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 21 of its 31 references that are in the map. First posted on arXiv 15 Aug 2022.

Builds on

21 of 31 references.

References · 21

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  3. 2020Designing Network Design Spacescited by 954
  4. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
  5. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  6. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  7. 2021WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognitioncited by 221
  8. 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
  9. 2022Towards Metrical Reconstruction of Human Facescited by 165
  10. 2018Nonlinear 3D Face Morphable Modelcited by 157
  11. 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
  12. 2016Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Networkcited by 109
9 more
  1. 2018Unsupervised Training for 3D Morphable Model Regressioncited by 99
  2. 2021Sample and Computation Redistribution for Efficient Face Detectioncited by 86
  3. 2022Killing Two Birds with One Stone:Efficient and Robust Training of Face Recognition CNNs by Partial FCcited by 73
  4. 20223D face reconstruction with dense landmarkscited by 70
  5. 2017Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regressioncited by 66
  6. 2022WebFace260M: A Benchmark for Million-Scale Deep Face Recognitioncited by 41
  7. 2018DenseReg: Fully Convolutional Dense Shape Regression In-the-Wildcited by 32
  8. 2019Dense 3D Face Decoding over 2500FPS: Joint Texture & Shape Convolutional Mesh Decoderscited by 22
  9. 2019Joint Face Detection and Facial Motion Retargeting for Multiple Facescited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 0; 2026: 1.

4 papers.

  1. 2023ExpCLIP: Bridging Text and Facial Expressions via Semantic Alignmentcited by 13
  2. 2024Real-time 3D-aware Portrait Editing from a Single Imagecited by 10
  3. 2024Bidirectional Regression for Monocular 6DoF Head Pose Estimation and Reference System Alignmentcited by 0
  4. 2026Diffusion-Based Makeup Transfer with Facial Region-Aware Makeup Featurescited by 0