mlsanityData to 7 Oct 2026

Learning Neural Parametric Head Models

arXiv 2212.02761 ↗First posted 6 Dec 2022cs.CVcited by 73

Not on the map. Why?

Abstract (arXiv)

We propose a novel 3D morphable model for complete human heads based on hybrid neural fields. At the core of our model lies a neural parametric representation that disentangles identity and expressions in disjoint latent spaces. To this end, we capture a person's identity in a canonical space as a signed distance field (SDF), and model facial expressions with a neural deformation field. In addition, our representation achieves high-fidelity local detail by introducing an ensemble of local fields centered around facial anchor points. To facilitate generalization, we train our model on a newly-captured dataset of over 5200 head scans from 255 different identities using a custom high-end 3D scanning setup. Our dataset significantly exceeds comparable existing datasets, both with respect to quality and completeness of geometry, averaging around 3.5M mesh faces per scan. Finally, we demonstrate that our approach outperforms state-of-the-art methods in terms of fitting error and reconstruction quality.

Key facts. Cited by 73 papers in the map (data through 7 Oct 2026). Builds on 37 of its 59 references that are in the map. First posted on arXiv 6 Dec 2022.

Builds on

37 of 59 references.

References · 37

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  3. 2017Billion-scale similarity search with GPUscited by 2,477
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  6. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  7. 2020Convolutional Occupancy Networkscited by 760
  8. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  9. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  10. 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 230
  11. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  12. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
25 more
  1. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  2. 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
  3. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  4. 2018Nonlinear 3D Face Morphable Modelcited by 157
  5. 2017Morphable Face Models - An Open Frameworkcited by 138
  6. 2022Structured Local Radiance Fields for Human Avatar Modelingcited by 116
  7. 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
  8. 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
  9. 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
  10. 2020Learning Formation of Physically-Based Face Attributescited by 94
  11. 2019Towards High-fidelity Nonlinear 3D Face Morphable Modelcited by 91
  12. 2019Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generationcited by 89
  13. 2019SpiralNet++: A Fast and Highly Efficient Mesh Convolution Operatorcited by 89
  14. 2021NPMs: Neural Parametric Models for 3D Deformable Shapescited by 89
  15. 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
  16. 2019Controlling Neural Level Setscited by 76
  17. 2022gDNA: Towards Generative Detailed Neural Avatarscited by 72
  18. 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
  19. 2018On Learning 3D Face Morphable Model from In-the-wild Imagescited by 54
  20. 2019Combining 3D Morphable Models: A Large scale Face-and-Head Modelcited by 49
  21. 20173D Face Morphable Models "In-the-Wild"cited by 44
  22. 2014Multilinear Wavelets: A Statistical Shape Space for Human Facescited by 32
  23. 2022SPAMs: Structured Implicit Parametric Modelscited by 29
  24. 2021Learning Feature Aggregation for Deep 3D Morphable Modelscited by 13
  25. 2021AIR-Nets: An Attention-Based Framework for Locally Conditioned Implicit Representationscited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 14; 2024: 22; 2025: 24; 2026: 12.

73 papers.

Sort:

By area:

  1. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  2. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  3. 2024Advances in 3D Generation: A Surveycited by 62
  4. 2023FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Modelscited by 55
  5. 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
  6. 2024HeadGAP: Few-Shot 3D Head Avatar via Generalizable Gaussian Priorscited by 44
  7. 2023Neural Haircut: Prior-Guided Strand-Based Hair Reconstructioncited by 43
  8. 2023DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatarscited by 42
  9. 2024Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidancecited by 39
  10. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
  11. 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
  12. 2024Gaussian Eigen Models for Human Headscited by 21
38 more
  1. 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
  2. 2024MagicPose4D: Crafting Articulated Models with Appearance and Motion Controlcited by 18
  3. 2024PSAvatar: A Point-based Shape Model for Real-Time Head Avatar Animation with 3D Gaussian Splattingcited by 17
  4. 2024Joker: Conditional 3D Head Synthesis with Extreme Facial Expressionscited by 17
  5. 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
  6. 2024SurFhead: Affine Rig Blending for Geometrically Accurate 2D Gaussian Surfel Head Avatarscited by 15
  7. 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representationscited by 13
  8. 2024What You See is What You GAN: Rendering Every Pixel for High-Fidelity Geometry in 3D GANscited by 12
  9. 2024HeadEvolver: Text to Head Avatars via Expressive and Attribute-Preserving Mesh Deformationcited by 11
  10. 2023DPHMs: Diffusion Parametric Head Models for Depth-based Trackingcited by 10
  11. 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 10
  12. 2024GPHM: Gaussian Parametric Head Model for Monocular Head Avatar Reconstructioncited by 10
  13. 2025Monocular and Generalizable Gaussian Talking Head Animationcited by 10
  14. 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
  15. 2025SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D Gaussianscited by 8
  16. 2025Category-Agnostic Neural Object Riggingcited by 8
  17. 2025PhysRig: Differentiable Physics-Based Skinning and Rigging Framework for Realistic Articulated Object Modelingcited by 8
  18. 2022PhoMoH: Implicit Photorealistic 3D Models of Human Headscited by 7
  19. 2024Makeup Prior Models for 3D Facial Makeup Estimation and Applicationscited by 7
  20. 2024GASP: Gaussian Avatars with Synthetic Priorscited by 7
  21. 2025FreeUV: Ground-Truth-Free Realistic Facial UV Texture Recovery via Cross-Assembly Inference Strategycited by 7
  22. 2024ShapeFusion: A 3D diffusion model for localized shape editingcited by 6
  23. 2023Thera: Aliasing-Free Arbitrary-Scale Super-Resolution with Neural Heat Fieldscited by 5
  24. 2023HeadCraft: Modeling High-Detail Shape Variations for Animated 3DMMscited by 5
  25. 2024ID-to-3D: Expressive ID-guided 3D Heads via Score Distillation Samplingcited by 5
  26. 2023SFDM: Robust Decomposition of Geometry and Reflectance for Realistic Face Rendering from Sparse-view Imagescited by 4
  27. 2023Anatomically Constrained Implicit Face Modelscited by 4
  28. 2024SEREP: Semantic Facial Expression Representation for Robust In-the-Wild Capture and Retargetingcited by 4
  29. 2025ImHead: A Large-scale Implicit Morphable Model for Localized Head Modelingcited by 4
  30. 2023Head3D: Complete 3D Head Generation via Tri-plane Feature Distillationcited by 3
  31. 2025Controlling Avatar Diffusion with Learnable Gaussian Embeddingcited by 3
  32. 2025SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion Modelscited by 3
  33. 2025GeoAvatar: Adaptive Geometrical Gaussian Splatting for 3D Head Avatarcited by 3
  34. 2025VoluMe -- Authentic 3D Video Calls from Live Gaussian Splat Predictioncited by 3
  35. 2025SRM-Hair: Single Image Head Mesh Reconstruction via 3D Morphable Haircited by 2
  36. 2025BFSM: 3D Bidirectional Face-Skull Morphable Modelcited by 2
  37. 2025TexAvatars : Hybrid Texel-3D Representations for Stable Rigging of Photorealistic Gaussian Head Avatarscited by 2
  38. 2026NeuROK: Generative 4D Neural Object Kinematicscited by 2

50 most cited of 73 All 73 (JSON)