3D Morphable Face Models -- Past, Present and Future
Not on the map. Why?
Abstract (arXiv)
In this paper, we provide a detailed survey of 3D Morphable Face Models over the 20 years since they were first proposed. The challenges in building and applying these models, namely capture, modeling, image formation, and image analysis, are still active research topics, and we review the state-of-the-art in each of these areas. We also look ahead, identifying unsolved challenges, proposing directions for future research and highlighting the broad range of current and future applications.
Key facts. Cited by 269 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 43; 2022: 47; 2023: 64; 2024: 39; 2025: 48; 2026: 28.
269 papers.
Sort:
By area:
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2021GAN Inversion: A Surveycited by 366
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2022Towards Metrical Reconstruction of Human Facescited by 165
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
38 more
- 2021MoFaNeRF: Morphable Facial Neural Radiance Fieldcited by 94
- 2021GAN-Control: Explicitly Controllable GANscited by 91
- 2021LOLNeRF: Learn from One Lookcited by 84
- 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 81
- 2023FaceDiffuser: Speech-Driven 3D Facial Animation Synthesis Using Diffusioncited by 77
- 2023DiffusionRig: Learning Personalized Priors for Facial Appearance Editingcited by 74
- 2022Imitator: Personalized Speech-driven 3D Facial Animationcited by 73
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2024Advances in 3D Generation: A Surveycited by 62
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
- 2023Unsupervised Learning of Robust Spectral Shape Matchingcited by 57
- 2022Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videoscited by 50
- 2021AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANscited by 49
- 2021Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracingcited by 48
- 2022FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swappingcited by 44
- 2023Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videoscited by 44
- 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
- 2022StyleSwap: Style-Based Generator Empowers Robust Face Swappingcited by 39
- 2022FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstructioncited by 39
- 2024Media2Face: Co-speech Facial Animation Generation With Multi-Modality Guidancecited by 39
- 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
- 2021Practical Face Reconstruction via Differentiable Ray Tracingcited by 35
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 34
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Modelscited by 34
- 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
- 2021Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face Reconstructioncited by 33
- 2022REALY: Rethinking the Evaluation of 3D Face Reconstructioncited by 32
- 2022Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguationcited by 32
- 2023High-Fidelity 3D Face Generation from Natural Language Descriptionscited by 32
- 2021Riggable 3D Face Reconstruction via In-Network Optimizationcited by 31
- 2022DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Imagecited by 31
- 2022SunStage: Portrait Reconstruction and Relighting using the Sun as a Light Stagecited by 30
- 2022State of the Art in Dense Monocular Non-Rigid 3D Reconstructioncited by 30
- 2023FaceXHuBERT: Text-less Speech-driven E(X)pressive 3D Facial Animation Synthesis Using Self-Supervised Speech Representation Learningcited by 29
- 2023AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatarscited by 29
- 2022JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed Human Reconstructioncited by 26
- 2024Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolationcited by 26
- 2023Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wildcited by 25
50 most cited of 269 All 269 (JSON)
- 2026One Basis to Animate Them All: Gaussian Blendshape Distillation for Real-Time Avatars1 Oct 2026
- 2026EvolvingAvatar: Interactive 3D Head Generation That Adapts as Conversations Unfold28 Sep 2026
- 2026NeuralSRNF: Neural Square Root Normal Fields for the Statistical Shape Analysis and Generation of Nonrigid 3D and 4D Objects23 Sep 2026
- 2026Unwarping the Lens: A Physics-Grounded Approach to Video Glasses Removal20 Aug 2026
- 2026GNM Head: A Generative aNthropometric Model of the human head26 Jul 2026
- 2026Discovering Geometric Biases in 3D Face Reconstruction: A Curvature-Aware Spectral Framework for Fairness Evaluation8 Jul 2026
- 2026EmoteGPT: 3D Human Facial Expressions from Natural Language Descriptions2 Jul 2026
- 2026Hyper-Network Neural Functional Maps for Unsupervised Robust 3D Shape Matching29 Jun 2026
- 2026CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection18 Jun 2026
- 2026Topologically Consistent Multi-view 3D Head Reconstruction via Coarse-Guided Layered Surface Sampling29 May 2026
- 2026Archon: A Unified Multimodal Model for Holistic Digital Human Generation28 May 2026
- 2026SuperFace: Preference-Aligned Facial Expression Estimation Beyond Pseudo Supervision7 May 2026
38 more
- 2026Profile-Specific 3DMM Regression from a Single Lateral Face Image3 May 2026
- 2026Registration-Free Learnable Multi-View Capture of Faces in Dense Semantic Correspondence2 May 2026
- 2026Chatting about Upper-Body Expressive Human Pose and Shape Estimation20 Apr 2026
- 2026PartNerFace: Part-based Neural Radiance Fields for Animatable Facial Avatar Reconstruction15 Apr 2026
- 20263DRealHead: Few-Shot Detailed Head Avatar14 Apr 2026
- 2026Representing 3D Faces with Learnable B-Spline Volumes14 Apr 2026
- 2026PhysHead: Simulation-Ready Gaussian Head Avatars7 Apr 2026
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunities1 Apr 2026
- 2026FreeTalk: Emotional Topology-Free 3D Talking Heads16 Mar 2026
- 2026TDMM-LM: Bridging Facial Understanding and Animation via Language Models14 Mar 2026
- 2026SGMatch: Semantic-Guided Non-Rigid Shape Matching with Flow Regularization13 Mar 2026
- 2026Skullptor: High Fidelity 3D Head Reconstruction in Seconds with Multi-View Normal Prediction24 Feb 2026
- 2026Narrating For You: Prompt-guided Audio-visual Narrating Face Generation Employing Multi-entangled Latent Space20 Feb 2026
- 2026KaoLRM: Repurposing Pre-trained Large Reconstruction Models for Parametric 3D Face Reconstruction19 Jan 2026
- 2026LegacyAvatars: Volumetric Face Avatars For Traditional Graphics Pipelines18 Jan 2026
- 2026A survey of facial recognition techniques9 Jan 2026
- 2025BabyFlow: 3D modeling of realistic and expressive infant faces22 Dec 2025
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025Gaussian Pixel Codec Avatars: A Hybrid Representation for Efficient Rendering17 Dec 2025
- 2025Towards Seamless Interaction: Causal Turn-Level Modeling of Interactive 3D Conversational Head Dynamics17 Dec 2025
- 2025FIELDS: Face reconstruction with accurate Inference of Expression using Learning with Direct Supervision26 Nov 2025
- 2025STAvatar: Soft Binding and Temporal Density Control for Monocular 3D Head Avatars Reconstruction25 Nov 2025
- 2025Motion Transfer-Enhanced StyleGAN for Generating Diverse Macaque Facial Expressions20 Nov 2025
- 2025LSF-Animation: Label-Free Speech-Driven Facial Animation via Implicit Feature Representation23 Oct 2025
- 2025Learning Neural Parametric 3D Breast Shape Models for Metrical Surface Reconstruction From Monocular RGB Videos15 Oct 2025
- 2025ImHead: A Large-scale Implicit Morphable Model for Localized Head Modeling12 Oct 2025
- 2025ArchitectHead: Continuous Level of Detail Control for 3D Gaussian Head Avatars7 Oct 2025
- 2025MSMA: Multi-Scale Feature Fusion For Multi-Attribute 3D Face Reconstruction From Unconstrained Images15 Sep 2025
- 2025T2Bs: Text-to-Character Blendshapes via Video Generation12 Sep 2025
- 2025Hierarchical MLANet: Multi-level Attention for 3D Face Reconstruction From Single Images12 Sep 2025
- 2025Posterior shape models revisited: Improving 3D reconstructions from partial data using target specific models6 Sep 2025
- 2025GRMM: Real-Time High-Fidelity Gaussian Morphable Head Model with Learned Residuals2 Sep 2025
- 2025Advances and Trends in the 3D Reconstruction of the Shape and Motion of Animals22 Aug 2025
- 2025EAvatar: Expression-Aware Head Avatar Reconstruction with Generative Geometry Priors19 Aug 2025
- 2025Express4D: Expressive, Friendly, and Extensible 4D Facial Motion Generation Benchmark17 Aug 2025
- 2025RealTalk: Realistic Emotion-Aware Lifelike Talking-Head Synthesis16 Aug 2025
- 2025FantasyTalking2: Timestep-Layer Adaptive Preference Optimization for Audio-Driven Portrait Animation15 Aug 2025
- 2025StyleMM: Stylized 3D Morphable Face Model via Text-Driven Aligned Image Translation15 Aug 2025
50 newest of 269 All 269 (JSON)
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Modelscited by 34
- 2023AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatarscited by 29
- 2024EmotiveTalk: Expressive Talking Head Generation through Audio Information Decoupling and Emotional Video Diffusioncited by 16
- 20233DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editingcited by 15
- 2025FantasyPortrait: Enhancing Multi-Character Portrait Animation with Expression-Augmented Diffusion Transformerscited by 12
- 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Modelscited by 6
- 2024AnimateMe: 4D Facial Expressions via Diffusion Modelscited by 6
- 2024ShapeFusion: A 3D diffusion model for localized shape editingcited by 6
- 2025T2Bs: Text-to-Character Blendshapes via Video Generationcited by 2
- 2025Bringing Diversity from Diffusion Models to Semantic-Guided Face Asset Generationcited by 0
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPScited by 0
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025T2Bs: Text-to-Character Blendshapes via Video Generation12 Sep 2025
- 2025FantasyPortrait: Enhancing Multi-Character Portrait Animation with Expression-Augmented Diffusion Transformers17 Jul 2025
- 2025Bringing Diversity from Diffusion Models to Semantic-Guided Face Asset Generation21 Apr 2025
- 2024EmotiveTalk: Expressive Talking Head Generation through Audio Information Decoupling and Emotional Video Diffusion23 Nov 2024
- 2024ShapeFusion: A 3D diffusion model for localized shape editing28 Mar 2024
- 2024AnimateMe: 4D Facial Expressions via Diffusion Models25 Mar 2024
- 20233DiFACE: Diffusion-based Speech-driven 3D Facial Animation and Editing1 Dec 2023
- 2023Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models10 Jul 2023
- 2023AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars1 Jun 2023
- 2023Relightify: Relightable 3D Faces from a Single Image via Diffusion Models10 May 2023
- 2022Deep Structural Causal Shape Modelscited by 11
- 2022Deep Structural Causal Shape Models23 Aug 2022
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2021GAN Inversion: A Surveycited by 366
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2021Neural Head Avatars from Monocular RGB Videoscited by 212
- 2022Towards Metrical Reconstruction of Human Facescited by 165
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 124
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2022Recovering 3D Human Mesh from Monocular Images: A Surveycited by 103
- 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
12 most cited of 256 All 256 (JSON)
- 2026One Basis to Animate Them All: Gaussian Blendshape Distillation for Real-Time Avatars1 Oct 2026
- 2026EvolvingAvatar: Interactive 3D Head Generation That Adapts as Conversations Unfold28 Sep 2026
- 2026NeuralSRNF: Neural Square Root Normal Fields for the Statistical Shape Analysis and Generation of Nonrigid 3D and 4D Objects23 Sep 2026
- 2026Unwarping the Lens: A Physics-Grounded Approach to Video Glasses Removal20 Aug 2026
- 2026GNM Head: A Generative aNthropometric Model of the human head26 Jul 2026
- 2026Discovering Geometric Biases in 3D Face Reconstruction: A Curvature-Aware Spectral Framework for Fairness Evaluation8 Jul 2026
- 2026EmoteGPT: 3D Human Facial Expressions from Natural Language Descriptions2 Jul 2026
- 2026Hyper-Network Neural Functional Maps for Unsupervised Robust 3D Shape Matching29 Jun 2026
- 2026CUPID: Reconstructing UV Texture Maps for Interpretable Person-of-Interest Deepfake Detection18 Jun 2026
- 2026Topologically Consistent Multi-view 3D Head Reconstruction via Coarse-Guided Layered Surface Sampling29 May 2026
- 2026Archon: A Unified Multimodal Model for Holistic Digital Human Generation28 May 2026
- 2026SuperFace: Preference-Aligned Facial Expression Estimation Beyond Pseudo Supervision7 May 2026
12 newest of 256 All 256 (JSON)