mlsanityData to 7 Oct 2026

ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representations

arXiv 2203.14510 ↗First posted 28 Mar 2022cs.CVcited by 64

Not on the map. Why?

Abstract (arXiv)

Precise representations of 3D faces are beneficial to various computer vision and graphics applications. Due to the data discretization and model linearity, however, it remains challenging to capture accurate identity and expression clues in current studies. This paper presents a novel 3D morphable face model, namely ImFace, to learn a nonlinear and continuous space with implicit neural representations. It builds two explicitly disentangled deformation fields to model complex shapes associated with identities and expressions, respectively, and designs an improved learning strategy to extend embeddings of expressions to allow more diverse changes. We further introduce a Neural Blend-Field to learn sophisticated details by adaptively blending a series of local fields. In addition to ImFace, an effective preprocessing pipeline is proposed to address the issue of watertight input requirement in implicit representations, enabling them to work with common facial surfaces for the first time. Extensive experiments are performed to demonstrate the superiority of ImFace.

Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Builds on 41 of its 68 references that are in the map. First posted on arXiv 28 Mar 2022.

Builds on

41 of 68 references.

References · 41

  1. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  2. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  4. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  5. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  6. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  7. 2020Convolutional Occupancy Networkscited by 760
  8. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  9. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  10. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  11. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  12. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
29 more
  1. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
  2. 20193D Morphable Face Models -- Past, Present and Futurecited by 269
  3. 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
  4. 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
  5. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  6. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  7. 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
  8. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  9. 2018Nonlinear 3D Face Morphable Modelcited by 157
  10. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
  11. 2020Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondencecited by 119
  12. 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
  13. 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 102
  14. 2019Towards High-fidelity Nonlinear 3D Face Morphable Modelcited by 91
  15. 2019Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generationcited by 89
  16. 2020Deep Implicit Templates for 3D Shape Representationcited by 86
  17. 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
  18. 2021Learning Signed Distance Field for Multi-view Surface Reconstructioncited by 76
  19. 20213D Shape Generation with Grid-based Implicit Functionscited by 48
  20. 2019MeshGAN: Non-linear 3D Morphable Models of Facescited by 39
  21. 2021Phase Transitions, Distance Functions, and Implicit Neural Representationscited by 38
  22. 2020Learning Complete 3D Morphable Face Models from Images and Videoscited by 35
  23. 2014Multilinear Wavelets: A Statistical Shape Space for Human Facescited by 32
  24. 2020Learning Implicit Functions for Topology-Varying Dense 3D Shape Correspondencecited by 27
  25. 20193D Face Modeling From Diverse Raw Scan Datacited by 25
  26. 2021OctField: Hierarchical Implicit Functions for 3D Modelingcited by 25
  27. 2020Shape My Face: Registering 3D Face Scans by Surface-to-Surface Translationcited by 14
  28. 2021Learning Feature Aggregation for Deep 3D Morphable Modelscited by 13
  29. 2014Dense 3D Face Correspondencecited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 22; 2024: 17; 2025: 10; 2026: 8.

64 papers.

Sort:

By area:

  1. 2023FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embeddingcited by 107
  2. 2023AvatarReX: Real-time Expressive Full-body Avatarscited by 83
  3. 2022Learning Neural Parametric Head Modelscited by 73
  4. 2024Advances in 3D Generation: A Surveycited by 62
  5. 2024Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidancecited by 39
  6. 2022Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Videocited by 37
  7. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
  8. 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
  9. 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
  10. 2023Towards Practical Capture of High-Fidelity Relightable Avatarscited by 34
  11. 2023High-Fidelity 3D Face Generation from Natural Language Descriptionscited by 32
  12. 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
38 more
  1. 2024SphereHead: Stable 3D Full-head Synthesis with Spherical Tri-plane Representationcited by 30
  2. 2024VRMM: A Volumetric Relightable Morphable Head Modelcited by 19
  3. 2022Neural Parameterization for Dynamic Human Head Editingcited by 16
  4. 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
  5. 2023Implicit Neural Head Synthesis via Controllable Local Deformation Fieldscited by 14
  6. 2022An Implicit Parametric Morphable Dental Modelcited by 12
  7. 2023NeuFace: Realistic 3D Neural Face Rendering from Multi-view Imagescited by 12
  8. 2023DPHMs: Diffusion Parametric Head Models for Depth-based Trackingcited by 10
  9. 2023ImFace++: A Sophisticated Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 10
  10. 20233D Points Splatting for Real-Time Dynamic Hand Reconstructioncited by 10
  11. 2022Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objectscited by 8
  12. 2023Implicit Shape and Appearance Priors for Few-Shot Full Head Reconstructioncited by 8
  13. 2024NeRFFaceSpeech: One-shot Audio-driven 3D Talking Head Synthesis via Generative Priorcited by 8
  14. 2025SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D Gaussianscited by 8
  15. 2022PhoMoH: Implicit Photorealistic 3D Models of Human Headscited by 7
  16. 2023Deformable Model-Driven Neural Rendering for High-Fidelity 3D Reconstruction of Human Heads Under Low-View Settingscited by 7
  17. 2023Human 3D Avatar Modeling with Implicit Neural Representation: A Brief Surveycited by 7
  18. 2024Neuromorphic Facial Analysis with Cross-Modal Supervisioncited by 7
  19. 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Imagecited by 7
  20. 20233D Generative Model Latent Disentanglement via Local Eigenprojectioncited by 6
  21. 2023ASM: Adaptive Skinning Model for High-Quality 3D Face Modelingcited by 6
  22. 2024Learning a Generalized Physical Face Model From Datacited by 6
  23. 2024Attention Beats Linear for Fast Implicit Neural Representation Generationcited by 6
  24. 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesiscited by 6
  25. 2023Thera: Aliasing-Free Arbitrary-Scale Super-Resolution with Neural Heat Fieldscited by 5
  26. 2024Towards Croppable Implicit Neural Representationscited by 5
  27. 2023SFDM: Robust Decomposition of Geometry and Reflectance for Realistic Face Rendering from Sparse-view Imagescited by 4
  28. 2023Anatomically Constrained Implicit Face Modelscited by 4
  29. 2025ImHead: A Large-scale Implicit Morphable Model for Localized Head Modelingcited by 4
  30. 2025Geometric implicit neural representations for signed distance functionscited by 4
  31. 2024StrandHead: Text to Hair-Disentangled 3D Head Avatars Using Human-Centric Priorscited by 3
  32. 2025Controlling Avatar Diffusion with Learnable Gaussian Embeddingcited by 3
  33. 2025SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion Modelscited by 3
  34. 2024FaceLift: Semi-supervised 3D Facial Landmark Localizationcited by 2
  35. 2024FAGhead: Fully Animate Gaussian Head from Monocular Videoscited by 2
  36. 2024Spatio-temporal Transformers for Action Unit Classification with Event Camerascited by 2
  37. 20243D Face Modeling via Weakly-supervised Disentanglement Network joint Identity-consistency Priorcited by 1
  38. 2024FaceCom: Towards High-fidelity 3D Facial Shape Completion via Optimization and Inpainting Guidancecited by 1

50 most cited of 64 All 64 (JSON)