mlsanityData to 7 Oct 2026

3D Face Reconstruction by Learning from Synthetic Data

arXiv 1609.04387 ↗First posted 14 Sep 2016cs.CVcited by 64

Not on the map. Why?

Abstract (arXiv)

Fast and robust three-dimensional reconstruction of facial geometric structure from a single image is a challenging task with numerous applications. Here, we introduce a learning-based approach for reconstructing a three-dimensional face from a single image. Recent face recovery methods rely on accurate localization of key characteristic points. In contrast, the proposed approach is based on a Convolutional-Neural-Network (CNN) which extracts the face geometry directly from its image. Although such deep architectures outperform other models in complex computer vision problems, training them properly requires a large dataset of annotated examples. In the case of three-dimensional faces, currently, there are no large volume data sets, while acquiring such big-data is a tedious task. As an alternative, we propose to generate random, yet nearly photo-realistic, facial images for which the geometric form is known. The suggested model successfully recovers facial shapes from real images, even for faces with extreme expressions and under various lighting conditions.

Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Sep 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 23; 2022: 15; 2023: 10; 2024: 10; 2025: 3; 2026: 3.

64 papers.

Sort:

  1. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  2. 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
  3. 2022Towards Metrical Reconstruction of Human Facescited by 165
  4. 2021SynFace: Face Recognition with Synthetic Datacited by 106
  5. 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
  6. 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 81
  7. 20223D face reconstruction with dense landmarkscited by 70
  8. 2021AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANscited by 49
  9. 2022Neural Cloth Simulationcited by 36
  10. 2021Lipstick ain't enough: Beyond Color Matching for In-the-Wild Makeup Transfercited by 35
  11. 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
  12. 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
38 more
  1. 2021Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face Reconstructioncited by 33
  2. 2021Deep Learning-based Face Super-Resolution: A Surveycited by 32
  3. 2022REALY: Rethinking the Evaluation of 3D Face Reconstructioncited by 32
  4. 2021Riggable 3D Face Reconstruction via In-Network Optimizationcited by 31
  5. 2022Synthetic Data in Human Analysis: A Surveycited by 28
  6. 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Headscited by 22
  7. 2022Video-driven Neural Physically-based Facial Asset for Productioncited by 17
  8. 2021Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collectioncited by 16
  9. 2021High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptationcited by 13
  10. 2022SIRA: Relightable Avatars from a Single Imagecited by 12
  11. 2023Bias and Diversity in Synthetic-based Face Recognitioncited by 11
  12. 2023GAPS: Geometry-Aware, Physics-Based, Self-Supervised Neural Garment Drapingcited by 9
  13. 2022Controllable 3D Generative Adversarial Face Model via Disentangling Shape and Appearancecited by 8
  14. 2023Implicit Shape and Appearance Priors for Few-Shot Full Head Reconstructioncited by 8
  15. 2024VariFace: Fair and Diverse Synthetic Dataset Generation for Face Recognitioncited by 8
  16. 2021Unsupervised High-Fidelity Facial Texture Generation and Reconstructioncited by 6
  17. 2023RAFaRe: Learning Robust and Accurate Non-parametric 3D Face Reconstruction from Pseudo 2D&3D Pairscited by 6
  18. 2023A Perceptual Shape Loss for Monocular 3D Face Reconstructioncited by 6
  19. 2024SPARK: Self-supervised Personalized Real-time Monocular Face Capturecited by 6
  20. 2021Weakly-Supervised Multi-Face 3D Reconstructioncited by 5
  21. 2022Mesh-Tension Driven Expression-Based Wrinkles for Synthetic Facescited by 5
  22. 2021Toward Realistic Single-View 3D Object Reconstruction with Unsupervised Learning from Multiple Imagescited by 4
  23. 2023Improved Static Hand Gesture Classification on Deep Convolutional Neural Networks using Novel Sterile Training Techniquecited by 4
  24. 2023InstantAvatar: Efficient 3D Head Reconstruction via Surface Renderingcited by 4
  25. 2021UnrealROX+: An Improved Tool for Acquiring Synthetic Data from Virtual 3D Environmentscited by 3
  26. 2021Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstructioncited by 3
  27. 2021Self-Supervised Robustifying Guidance for Monocular 3D Face Reconstructioncited by 3
  28. 2022NARRATE: A Normal Assisted Free-View Portrait Stylizercited by 3
  29. 2024Exploring 3D Face Reconstruction and Fusion Methods for Face Verification: A Case-Study in Video Surveillancecited by 3
  30. 2021A Pipeline for Vision-Based On-Orbit Proximity Operations Using Deep Learning and Synthetic Imagerycited by 2
  31. 2021Reconstructing Recognizable 3D Face Shapes based on 3D Morphable Modelscited by 2
  32. 20223D Dense Face Alignment with Fused Features by Aggregating CNNs and GCNscited by 2
  33. 2022Can Shadows Reveal Biometric Information?cited by 2
  34. 20233D Facial Imperfection Regeneration: Deep learning approach and 3D printing prototypescited by 2
  35. 2024Facing Asymmetry -- Uncovering the Causal Link between Facial Symmetry and Expression Classifiers using Synthetic Interventionscited by 2
  36. 2021Neural Relighting and Expression Transfer On Video Portraitscited by 1
  37. 2021A Review of 3D Face Reconstruction From a Single Imagecited by 1
  38. 2021Using Synthetic Images To Uncover Population Biases In Facial Landmarks Detectioncited by 1

50 most cited of 64 All 64 (JSON)