mlsanityData to 7 Oct 2026

FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Dataset

arXiv 2203.14057 ↗First posted 26 Mar 2022cs.CVcited by 98

Not on the map. Why?

Abstract (arXiv)

We present FaceVerse, a fine-grained 3D Neural Face Model, which is built from hybrid East Asian face datasets containing 60K fused RGB-D images and 2K high-fidelity 3D head scan models. A novel coarse-to-fine structure is proposed to take better advantage of our hybrid dataset. In the coarse module, we generate a base parametric model from large-scale RGB-D images, which is able to predict accurate rough 3D face models in different genders, ages, etc. Then in the fine module, a conditional StyleGAN architecture trained with high-fidelity scan models is introduced to enrich elaborate facial geometric and texture details. Note that different from previous methods, our base and detailed modules are both changeable, which enables an innovative application of adjusting both the basic attributes and the facial details of 3D face models. Furthermore, we propose a single-image fitting framework based on differentiable rendering. Rich experiments show that our method outperforms the state-of-the-art methods.

Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). Builds on 26 of its 48 references that are in the map. First posted on arXiv 26 Mar 2022.

Builds on

26 of 48 references.

References · 26

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  2. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  3. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  4. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  5. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  6. 2021Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensorscited by 246
  7. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  8. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  9. 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
  10. 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
  11. 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
  12. 2018Nonlinear 3D Face Morphable Modelcited by 157
14 more
  1. 2016Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Networkcited by 109
  2. 2020Learning Formation of Physically-Based Face Attributescited by 94
  3. 2017Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hzcited by 91
  4. 2019Towards High-fidelity Nonlinear 3D Face Morphable Modelcited by 91
  5. 2016Learning Detailed Face Reconstruction from a Single Imagecited by 71
  6. 2021DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Camerascited by 67
  7. 2017Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translationcited by 56
  8. 2019Disentangled Representation Learning for 3D Face Shapecited by 48
  9. 2017End-to-end 3D face reconstruction with deep neural networkscited by 47
  10. 2020High-Fidelity 3D Digital Human Head Creation from RGB-D Selfiescited by 47
  11. 2019Photo-Realistic Facial Details Synthesis from Single Imagecited by 40
  12. 2014Multilinear Wavelets: A Statistical Shape Space for Human Facescited by 32
  13. 2019Self-supervised Learning of Detailed 3D Face Reconstructioncited by 21
  14. 2018View Extrapolation of Human Body from a Single Imagecited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 13; 2023: 28; 2024: 16; 2025: 27; 2026: 14.

98 papers.

Sort:

By area:

  1. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  2. 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
  3. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  4. 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
  5. 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 83
  6. 2022KeypointNeRF: Generalizing Image-based Volumetric Avatars using Relative Spatial Encoding of Keypointscited by 77
  7. 2023DiffusionRig: Learning Personalized Priors for Facial Appearance Editingcited by 74
  8. 2022AvatarMAV: Fast 3D Head Avatar Reconstruction Using Motion-Aware Neural Voxelscited by 73
  9. 2022Learning Neural Parametric Head Modelscited by 73
  10. 2022ClipFace: Text-guided Editing of Textured 3D Morphable Modelscited by 59
  11. 2023StyleAvatar: Real-time Photo-realistic Portrait Avatar from a Single Videocited by 52
  12. 2022Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videoscited by 50
38 more
  1. 2023VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Priorcited by 47
  2. 2024NPGA: Neural Parametric Gaussian Avatarscited by 46
  3. 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
  4. 2022FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstructioncited by 39
  5. 20233D Face Reconstruction with the Geometric Guidance of Facial Part Segmentationcited by 38
  6. 2023HAvatar: High-fidelity Head Avatar via Facial Model Conditioned Neural Radiance Fieldcited by 37
  7. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  8. 2023HHAvatar: Gaussian Head Avatar with Dynamic Hairscited by 35
  9. 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
  10. 2023HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Detailscited by 22
  11. 2024TextToon: Real-Time Text Toonify Head Avatar from Single Videocited by 21
  12. 2023InvertAvatar: Incremental GAN Inversion for Generalized Head Avatarscited by 19
  13. 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformerscited by 19
  14. 2023MoSAR: Monocular Semi-Supervised Model for Avatar Reconstruction using Differentiable Shadingcited by 18
  15. 2023GANHead: Towards Generative Animatable Neural Head Avatarscited by 17
  16. 2023ReactFace: Online Multiple Appropriate Facial Reaction Generation in Dyadic Interactionscited by 17
  17. 2022Neural Parameterization for Dynamic Human Head Editingcited by 16
  18. 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
  19. 2024REACT 2024: the Second Multiple Appropriate Facial Reaction Generation Challengecited by 16
  20. 2024Tri2-plane: Thinking Head Avatar via Feature Pyramidcited by 16
  21. 2025AvatarArtist: Open-Domain 4D Avatarizationcited by 15
  22. 202550 Years of Automated Face Recognitioncited by 13
  23. 2022BareSkinNet: De-makeup and De-lighting via 3D Face Reconstructioncited by 10
  24. 2024GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstructioncited by 10
  25. 2022Towards 3D Face Reconstruction in Perspective Projection: Estimating 6DoF Face Pose from Monocular Imagecited by 9
  26. 2024Spectrum AUC Difference (SAUCD): Human-aligned 3D Shape Evaluationcited by 9
  27. 2024DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Imagecited by 9
  28. 2025OmniTalker: One-shot Real-time Text-Driven Talking Audio-Video Generation With Multimodal Style Mimickingcited by 9
  29. 2025REACT 2025: the Third Multiple Appropriate Facial Reaction Generation Challengecited by 9
  30. 2023Implicit Shape and Appearance Priors for Few-Shot Full Head Reconstructioncited by 8
  31. 2024Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360degcited by 8
  32. 2025ChatAnyone: Stylized Real-time Portrait Video Generation with Hierarchical Motion Diffusion Modelcited by 8
  33. 2022PhoMoH: Implicit Photorealistic 3D Models of Human Headscited by 7
  34. 2023Deformable Model-Driven Neural Rendering for High-Fidelity 3D Reconstruction of Human Heads Under Low-View Settingscited by 7
  35. 2023Semantify: Simplifying the Control of 3D Morphable Models using CLIPcited by 7
  36. 2024Makeup Prior Models for 3D Facial Makeup Estimation and Applicationscited by 7
  37. 2025FreeUV: Ground-Truth-Free Realistic Facial UV Texture Recovery via Cross-Assembly Inference Strategycited by 7
  38. 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Imagecited by 7

50 most cited of 98 All 98 (JSON)