Topologically Consistent Multi-view 3D Head Reconstruction via Coarse-Guided Layered Surface Sampling
Not on the map. Why?
Abstract (arXiv)
We present SHELLS (Semantic Head Estimation via Layered Local Sampling), an efficient feed-forward framework for 3D head reconstruction in dense semantic correspondence from multi-view images. Existing methods typically refine vertices independently via localized feature volumes. This approach couples memory-intensive feature sampling to mesh resolution, which limits scalability for dense topologies (> 10k vertices) and introduces surface noise. In contrast, SHELLS decouples feature extraction from mesh resolution via a hierarchical sampling strategy. We extract multi-view features using a DINOv2 backbone with LoRA adaptation, projectively sample a sparse global feature cloud, and predict an intermediate coarse mesh. This coarse prior guides the construction of layered, surface-aware sampling shells that serve as a discrete search space for the final reconstruction. SHELLS maintains surface consistency while using 88% less inference GPU memory (2.4GB vs. 20GB) than volumetric baselines. It reduces median registration error by 21% to 29% with a 3.5x inference speedup (0.08s vs. 0.29s) for 18k-vertex meshes. Notably, our model is trained exclusively on synthetic data yet generalizes effectively to real-world captures, eliminating the need for the costly, pre-registered multi-view datasets common in prior work.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 3 of its 14 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
3 of 14 references.
References · 3
- 20193D Morphable Face Models -- Past, Present and Futurecited by 270
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 181
- 2024Learning to Stabilize Facescited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Head3D: Complete 3D Head Generation via Tri-plane Feature Distillation
- 2024VGGHeads: 3D Multi Head Alignment with a Large-Scale Synthetic Dataset
- 2026Multi-view Consistent 3D Gaussian Head Avatars 'without' Multi-view Generation
- 2026TOPOS: High-Fidelity and Efficient Industry-Grade 3D Head Generation
- 2024FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Heads
- 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models
- 2025ConsistentDreamer: View-Consistent Meshes Through Balanced Multi-View Gaussian Optimization
- 2026MoE3D: A Mixture-of-Experts Module for 3D Reconstruction