mlsanityData to 14 Oct 2026

FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction

arXiv 2111.01082 ↗First posted 1 Nov 2021cs.CV cs.GRcited by 36

Not on the map. Why?

Abstract (arXiv)

In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and the corresponding benchmark to evaluate single-view facial 3D reconstruction. By training on FaceScape data, a novel algorithm is proposed to predict elaborate riggable 3D face models from a single image input. FaceScape dataset releases 16,940 textured 3D faces, captured from 847 subjects and each with 20 specific expressions. The 3D models contain the pore-level facial geometry that is also processed to be topologically uniform. These fine 3D facial models can be represented as a 3D morphable model for coarse shapes and displacement maps for detailed geometry. Taking advantage of the large-scale and high-accuracy dataset, a novel algorithm is further proposed to learn the expression-specific dynamic details using a deep neural network. The learned relationship serves as the foundation of our 3D face prediction system from a single image input. Different from most previous methods, our predicted 3D models are riggable with highly detailed geometry under different expressions. We also use FaceScape data to generate the in-the-wild and in-the-lab benchmark to evaluate recent methods of single-view face reconstruction. The accuracy is reported and analyzed on the dimensions of camera pose and focal length, which provides a faithful and comprehensive evaluation and reveals new challenges. The unprecedented dataset, benchmark, and code have been released at https://github.com/zhuhao-nju/facescape.

Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 49 of its 122 references that are in the map. First posted on arXiv 1 Nov 2021.

Builds on

49 of 122 references.

References · 49

  1. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  2. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  3. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
  4. 2016Least Squares Generative Adversarial Networkscited by 1,001
  5. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  6. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
  7. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  8. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
  9. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
  10. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  11. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
  12. 20193D Morphable Face Models -- Past, Present and Futurecited by 270
37 more
  1. 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 268
  2. 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
  3. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  4. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  5. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  6. 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
  7. 2019Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervisioncited by 176
  8. 2018Deep Appearance Models for Face Renderingcited by 164
  9. 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
  10. 2018Nonlinear 3D Face Morphable Modelcited by 157
  11. 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
  12. 2018Face Alignment in Full Pose Range: A 3D Total Solutioncited by 148
  13. 2017SfSNet: Learning Shape, Reflectance and Illuminance of Faces in the Wildcited by 110
  14. 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
  15. 2018Unsupervised Training for 3D Morphable Model Regressioncited by 100
  16. 2017Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hzcited by 91
  17. 2019Towards High-fidelity Nonlinear 3D Face Morphable Modelcited by 91
  18. 2020AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"cited by 91
  19. 2019Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generationcited by 90
  20. 2020Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistencycited by 78
  21. 2016Learning Detailed Face Reconstruction from a Single Imagecited by 71
  22. 2017Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regressioncited by 66
  23. 2017Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translationcited by 56
  24. 2018On Learning 3D Face Morphable Model from In-the-wild Imagescited by 54
  25. 2019Disentangled Representation Learning for 3D Face Shapecited by 48
  26. 2017End-to-end 3D face reconstruction with deep neural networkscited by 47
  27. 20173D Face Morphable Models "In-the-Wild"cited by 44
  28. 2019Photo-Realistic Facial Details Synthesis from Single Imagecited by 40
  29. 2019MeshGAN: Non-linear 3D Morphable Models of Facescited by 39
  30. 2014Multilinear Wavelets: A Statistical Shape Space for Human Facescited by 32
  31. 2018Disentangling Features in 3D Face Shapes for Joint Face Reconstruction and Recognitioncited by 27
  32. 2021SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstructioncited by 27
  33. 2018Evaluation of Dense 3D Reconstruction from 2D Face Images in the Wildcited by 22
  34. 2019Dense 3D Face Decoding over 2500FPS: Joint Texture & Shape Convolutional Mesh Decoderscited by 22
  35. 2019Self-supervised Learning of Detailed 3D Face Reconstructioncited by 21
  36. 2019Joint Face Detection and Facial Motion Retargeting for Multiple Facescited by 18
  37. 2021Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collectioncited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 4; 2023: 8; 2024: 7; 2025: 12; 2026: 4.

36 papers.

Sort:

By area:

  1. 2022Towards Metrical Reconstruction of Human Facescited by 166
  2. 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
  3. 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
  4. 2023AvatarBooth: High-Quality and Customizable 3D Human Avatar Generationcited by 37
  5. 2023Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesiscited by 37
  6. 2023High-Fidelity 3D Face Generation from Natural Language Descriptionscited by 33
  7. 2024FATE: Full-head Gaussian Avatar with Textural Editing from Monocular Videocited by 32
  8. 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
  9. 2024EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Headcited by 16
  10. 2022Detailed Facial Geometry Recovery from Multi-View Images by Learning an Implicit Functioncited by 14
  11. 2023ReliTalk: Relightable Talking Portrait Generation from a Single Videocited by 12
  12. 2024Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360degcited by 9
24 more
  1. 2023Implicit Shape and Appearance Priors for Few-Shot Full Head Reconstructioncited by 8
  2. 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Imagecited by 7
  3. 2023RAFaRe: Learning Robust and Accurate Non-parametric 3D Face Reconstruction from Pseudo 2D&3D Pairscited by 6
  4. 2024GRAPE: Generalizable and Robust Multi-view Facial Capturecited by 6
  5. 2024Towards Native Generative Model for 3D Head Avatarcited by 5
  6. 2023DF-3DFace: One-to-Many Speech Synchronized 3D Face Animation with Diffusioncited by 3
  7. 2025Controlling Avatar Diffusion with Learnable Gaussian Embeddingcited by 3
  8. 2025SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion Modelscited by 3
  9. 2022FLNeRF: 3D Facial Landmarks Estimation in Neural Radiance Fieldscited by 2
  10. 2024Facing Asymmetry -- Uncovering the Causal Link between Facial Symmetry and Expression Classifiers using Synthetic Interventionscited by 2
  11. 2025High-Quality Facial Albedo Generation for 3D Face Reconstruction from a Single Image using a Coarse-to-Fine Approachcited by 2
  12. 2025Micro-macro Gaussian Splatting with Enhanced Scalability for Unconstrained Scene Reconstructioncited by 2
  13. 2024MixLight: Borrowing the Best of both Spherical Harmonics and Gaussian Modelscited by 1
  14. 2025Electromyography-Informed Facial Expression Reconstruction for Physiological-Based Synthesis and Analysiscited by 1
  15. 2025FedMeNF: Privacy-Preserving Federated Meta-Learning for Neural Fieldscited by 1
  16. 2025Pix2NPHM: Learning to Regress NPHM Reconstructions From a Single Imagecited by 1
  17. 2026KaoLRM: Repurposing Pre-trained Large Reconstruction Models for Parametric 3D Face Reconstructioncited by 1
  18. 2026OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologiescited by 1
  19. 2022From 2D Images to 3D Model:Weakly Supervised Multi-View Face Reconstruction with Deep Fusioncited by 0
  20. 2025PAL-Net: A Point-Wise CNN with Patch-Attention for 3D Facial Landmark Localizationcited by 0
  21. 2025GLVD: Guided Learned Vertex Descentcited by 0
  22. 2025Efficient Label Refinement for Face Parsing Under Extreme Poses Using 3D Gaussian Splattingcited by 0
  23. 2026ChromaGS: Text-Driven Semantic Editing of 4D Gaussian Avatarscited by 0
  24. 2026Integrating 3D Posture Neutralization with Statistical Shape Modeling for Head-Neck-Shoulder Ergonomic Designcited by 0