PhoMoH: Implicit Photorealistic 3D Models of Human Heads
Not on the map. Why?
Abstract (arXiv)
We present PhoMoH, a neural network methodology to construct generative models of photo-realistic 3D geometry and appearance of human heads including hair, beards, an oral cavity, and clothing. In contrast to prior work, PhoMoH models the human head using neural fields, thus supporting complex topology. Instead of learning a head model from scratch, we propose to augment an existing expressive head model with new features. Concretely, we learn a highly detailed geometry network layered on top of a mid-resolution head model together with a detailed, local geometry-aware, and disentangled color field. Our proposed architecture allows us to learn photo-realistic human head models from relatively little data. The learned generative geometry and appearance networks can be sampled individually and enable the creation of diverse and realistic human heads. Extensive experiments validate our method qualitatively and across different metrics.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 52 of its 82 references that are in the map. First posted on arXiv 14 Dec 2022.
Builds on
52 of 82 references.
References · 52
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016Improved Techniques for Training GANscited by 2,970
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
38 more
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
- 20193D Morphable Face Models -- Past, Present and Futurecited by 270
- 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 268
- 2019Neural Voice Puppetry: Audio-driven Facial Reenactmentcited by 250
- 2018Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodiescited by 239
- 2021I M Avatar: Implicit Morphable Head Avatars from Videoscited by 231
- 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2021Neural Head Avatars from Monocular RGB Videoscited by 213
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2018Nonlinear 3D Face Morphable Modelcited by 157
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2017Morphable Face Models - An Open Frameworkcited by 138
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2022Realistic One-shot Mesh-based Head Avatarscited by 119
- 2020i3DMM: Deep Implicit 3D Morphable Model of Human Headscited by 109
- 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
- 2021imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Posecited by 103
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2020DualSDF: Semantic Shape Manipulation using a Two-Level Representationcited by 82
- 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
- 2022Learning Neural Parametric Head Modelscited by 73
- 2022ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representationscited by 64
- 2019Towards a complete 3D morphable model of the human headcited by 63
- 2022LISA: Learning Implicit Shape and Appearance of Handscited by 63
- 2022COAP: Compositional Articulated Occupancy of Peoplecited by 59
- 2020A Morphable Face Albedo Modelcited by 54
- 2019Combining 3D Morphable Models: A Large scale Face-and-Head Modelcited by 49
- 20173D Face Morphable Models "In-the-Wild"cited by 44
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 1; 2025: 2.
7 papers.
- 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
- 2024SphereHead: Stable 3D Full-head Synthesis with Spherical Tri-plane Representationcited by 30
- 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterizationcited by 16
- 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Imagecited by 7
- 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesiscited by 6
- 2023HeadCraft: Modeling High-Detail Shape Variations for Animated 3DMMscited by 5
- 2023SPHEAR: Spherical Head Registration for Complete Statistical 3D Modelingcited by 0
- 2025HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesis20 Sep 2025
- 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Image9 Sep 2025
- 2024SphereHead: Stable 3D Full-head Synthesis with Spherical Tri-plane Representation8 Apr 2024
- 2023HeadCraft: Modeling High-Detail Shape Variations for Animated 3DMMs21 Dec 2023
- 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videos11 Dec 2023
- 2023SPHEAR: Spherical Head Registration for Complete Statistical 3D Modeling4 Nov 2023
- 2023Single-Shot Implicit Morphable Faces with Consistent Texture Parameterization4 May 2023