mlsanityData to 14 Oct 2026

Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network

arXiv 1803.07835 ↗First posted 21 Mar 2018cs.CV cs.GRcited by 195

Not on the map. Why?

Abstract (arXiv)

We propose a straightforward method that simultaneously reconstructs the 3D facial structure and provides dense alignment. To achieve this, we design a 2D representation called UV position map which records the 3D shape of a complete face in UV space, then train a simple Convolutional Neural Network to regress it from a single 2D image. We also integrate a weight mask into the loss function during training to improve the performance of the network. Our method does not rely on any prior face model, and can reconstruct full facial geometry along with semantic meaning. Meanwhile, our network is very light-weighted and spends only 9.8ms to process an image, which is extremely faster than previous works. Experiments on multiple challenging datasets show that our method surpasses other state-of-the-art methods on both reconstruction and alignment tasks by a large margin.

Key facts. Cited by 195 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Mar 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 66; 2022: 41; 2023: 41; 2024: 25; 2025: 11; 2026: 11.

195 papers.

Sort:

By area:

  1. 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
  2. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
  3. 2021FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integrationcited by 169
  4. 2022Towards Metrical Reconstruction of Human Facescited by 166
  5. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
  6. 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
  7. 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
  8. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  9. 2021The Power of Points for Modeling Humans in Clothingcited by 90
  10. 2021Sample and Computation Redistribution for Efficient Face Detectioncited by 89
  11. 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 84
  12. 2021Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmarkcited by 82
38 more
  1. 2022Domain Generalization via Shuffled Style Assembly for Face Anti-Spoofingcited by 73
  2. 20223D face reconstruction with dense landmarkscited by 70
  3. 2022Single Stage Virtual Try-on via Deformable Attention Flowscited by 65
  4. 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
  5. 2021I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modelingcited by 52
  6. 2021FaceX-Zoo: A PyTorch Toolbox for Face Recognitioncited by 49
  7. 2021Adaptive Normalized Representation Learning for Generalizable Face Anti-Spoofingcited by 49
  8. 2023HybrIK-X: Hybrid Analytical-Neural Inverse Kinematics for Whole-body Mesh Recoverycited by 49
  9. 2021Dual Reweighting Domain Generalization for Face Presentation Attack Detectioncited by 47
  10. 2021Generalizable Representation Learning for Mixture Domain Face Anti-Spoofingcited by 46
  11. 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
  12. 2023Instance-Aware Domain Generalization for Face Anti-Spoofingcited by 42
  13. 2021Masked Face Recognition Challenge: The InsightFace Track Reportcited by 41
  14. 2023SwinFace: A Multi-task Transformer for Face Recognition, Expression Recognition, Age Estimation and Attribute Estimationcited by 39
  15. 2023Text-Guided Generation and Editing of Compositional 3D Avatarscited by 39
  16. 20233D Face Reconstruction with the Geometric Guidance of Facial Part Segmentationcited by 38
  17. 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinementcited by 36
  18. 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 36
  19. 2021Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfercited by 35
  20. 2021ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priorscited by 35
  21. 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
  22. 2022REALY: Rethinking the Evaluation of 3D Face Reconstructioncited by 33
  23. 2023High-Fidelity 3D Face Generation from Natural Language Descriptionscited by 33
  24. 2021Deep Learning-based Face Super-Resolution: A Surveycited by 32
  25. 2021Riggable 3D Face Reconstruction via In-Network Optimizationcited by 31
  26. 2022Adaptive Mixture of Experts Learning for Generalizable Face Anti-Spoofingcited by 28
  27. 2021SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstructioncited by 27
  28. 2021Synergy between 3DMM and 3D Landmarks for Accurate 3D Facial Geometrycited by 27
  29. 2022Self-Supervised Geometry-Aware Encoder for Style-Based 3D GAN Inversioncited by 24
  30. 2022Multi-task head pose estimation in-the-wildcited by 23
  31. 2022H3WB: Human3.6M 3D WholeBody Dataset and Benchmarkcited by 23
  32. 2021SOGAN: 3D-Aware Shadow and Occlusion Robust GAN for Makeup Transfercited by 22
  33. 2022FNeVR: Neural Volume Rendering for Face Animationcited by 22
  34. 2022SUPR: A Sparse Unified Part-Based Human Representationcited by 21
  35. 2021Robust Model-based Face Reconstruction through Weakly-Supervised Outlier Segmentationcited by 20
  36. 2021Dual Spoof Disentanglement Generation for Face Anti-spoofing with Depth Uncertainty Learningcited by 20
  37. 2024Test-Time Domain Generalization for Face Anti-Spoofingcited by 20
  38. 2021Adversarial Mask: Real-World Universal Adversarial Attack on Face Recognition Modelcited by 19

50 most cited of 195 All 195 (JSON)