High-Fidelity Single-Image Head Modeling with Industry-Grade Topology
Not on the map. Why?
Abstract (arXiv)
We present a single-image head mesh reconstruction framework that addresses the longstanding challenge of simultaneously preserving facial identity and producing industry-grade topology. Our framework adopts a coarse-to-fine optimization pipeline that refines a rigged template across three stages -- rig, joint, and vertex -- achieving stable convergence and consistent topology. To mitigate the ill-posed nature of single-image 3D face reconstruction and ensure identity preservation, we employ a normal consistency objective jointly with landmark alignment. To further preserve local surface structure and enforce topological regularity, we introduce geometry-aware constraints based on Gaussian curvature and conformal consistency, along with auxiliary regularizations that correct fine artifacts such as lip seams and eyelid discontinuities. Our hierarchical optimization with geometry-aware regularization yields meshes with semantically meaningful edge flow and industry-grade topology. After geometry reconstruction, we extract UV-space texture and normal maps to preserve appearance details for visualization and downstream use. In a user study with 22 professional technical artists, our results were assessed as approaching industry-grade usability, and 95% of participants ranked our method as the top-performing approach, underscoring its effectiveness for real-world digital human production.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 86 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
39 of 86 references.
References · 39
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
27 more
- 2018Generating 3D faces using Convolutional Mesh Autoencoderscited by 267
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 2022RTMDet: An Empirical Study of Designing Real-Time Object Detectorscited by 192
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2022Towards Metrical Reconstruction of Human Facescited by 165
- 2018Nonlinear 3D Face Morphable Modelcited by 157
- 2022FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Datasetcited by 98
- 2024Generalizable and Animatable Gaussian Head Avatarcited by 95
- 2019Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generationcited by 89
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 82
- 2023DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidancecited by 79
- 2016Learning Detailed Face Reconstruction from a Single Imagecited by 71
- 2025LHM: Large Animatable Human Reconstruction Model from a Single Image in Secondscited by 61
- 2019Combining 3D Morphable Models: A Large scale Face-and-Head Modelcited by 49
- 20173D Face Morphable Models "In-the-Wild"cited by 44
- 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
- 2024GS^3: Efficient Relighting with Triple Gaussian Splattingcited by 42
- 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
- 2016Gaussian Process Morphable Modelscited by 31
- 20243D Face Tracking from 2D Video through Iterative Dense UV to Image Flowcited by 20
- 2023MoSAR: Monocular Semi-Supervised Model for Avatar Reconstruction using Differentiable Shadingcited by 18
- 2020JNR: Joint-based Neural Rig Representation for Compact 3D Face Modelingcited by 7
- 2024ARM: Appearance Reconstruction Model for Relightable 3D Generationcited by 7
- 2018Non-rigid 3D Shape Registration using an Adaptive Templatecited by 4
- 2023Laplacian ICP for Progressive Registration of 3D Human Head Meshescited by 2
- 2025HART: Human Aligned Reconstruction Transformercited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.