Skullptor: High Fidelity 3D Head Reconstruction in Seconds with Multi-View Normal Prediction
Not on the map. Why?
Abstract (arXiv)
Reconstructing high-fidelity 3D head geometry from images is critical for a wide range of applications, yet existing methods face fundamental limitations. Traditional photogrammetry achieves exceptional detail but requires extensive camera arrays (25-200+ views), substantial computation, and manual cleanup in challenging areas like facial hair. Recent alternatives present a fundamental trade-off: foundation models enable efficient single-image reconstruction but lack fine geometric detail, while optimization-based methods achieve higher fidelity but require dense views and expensive computation. We bridge this gap with a hybrid approach that combines the strengths of both paradigms. Our method introduces a multi-view surface normal prediction model that extends monocular foundation models with cross-view attention to produce geometrically consistent normals in a feed-forward pass. We then leverage these predictions as strong geometric priors within an inverse rendering optimization framework to recover high-frequency surface details. Our approach outperforms state-of-the-art single-image and multi-view methods, achieving high-fidelity reconstruction on par with dense-view photogrammetry while reducing camera requirements and computational cost.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 46 of its 70 references that are in the map. First posted on arXiv 24 Feb 2026.
Builds on
46 of 70 references.
References · 46
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
34 more
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 20193D Morphable Face Models -- Past, Present and Futurecited by 269
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
- 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
- 2022Multiface: A Dataset for Neural Face Renderingcited by 87
- 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2022Learning Neural Parametric Head Modelscited by 73
- 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 72
- 2017Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regressioncited by 66
- 2024CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Modelscited by 52
- 2020Towards High-Fidelity 3D Face Reconstruction from In-the-Wild Images Using Graph Convolutional Networkscited by 51
- 2021Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracingcited by 48
- 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
- 20233D Face Reconstruction with the Geometric Guidance of Facial Part Segmentationcited by 38
- 2021Practical Face Reconstruction via Differentiable Ray Tracingcited by 35
- 2022Facial Geometric Detail Recovery via Implicit Representationcited by 27
- 2024PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshingcited by 23
- 2023HiFace: High-Fidelity 3D Face Reconstruction by Learning Static and Dynamic Detailscited by 22
- 2025Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face Reconstructioncited by 20
- 2023MoSAR: Monocular Semi-Supervised Model for Avatar Reconstruction using Differentiable Shadingcited by 18
- 2022S2F2: Self-Supervised High Fidelity Face Reconstruction from Monocular Imagecited by 17
- 2023RNb-NeuS: Reflectance and Normal-based Multi-View 3D Reconstructioncited by 13
- 2025DAViD: Data-efficient and Accurate Vision Models from Synthetic Datacited by 11
- 2023RAFaRe: Learning Robust and Accurate Non-parametric 3D Face Reconstruction from Pseudo 2D&3D Pairscited by 6
- 2025Multi-view Surface Reconstruction Using Normal and Reflectance Cuescited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.