UVFaceFusion: Fast Multi-view Topologically Consistent Face Reconstruction in the Wild via UV-space Neural Fusion
Not on the map. Why?
Abstract (arXiv)
Reconstructing high-fidelity facial geometry with an assigned topology is essential for digital avatar creation and animation, yet existing automated methods often trade off geometric fidelity and in-the-wild generalization. We present UVFaceFusion, a feed-forward framework for multi-view, fixed-topology face reconstruction from daily images. Our key idea is to replace heuristic topological optimization with learnable neural fusion in a canonical UV space. Given multi-view images, we first obtain dense point maps and facial UV correspondences of each view using VGGT and Pixel3DMM, respectively. Then, the view-specific point maps are lifted into the canonical UV domain and fused with a novel mask-aware neural fusion network. The network predicts a complete UV-space point map, from which a fixed-topology mesh is directly sampled. Although trained only on Ava-256, UVFaceFusion generalizes well to multiple public benchmarks and in-the-wild captures, benefiting from its canonical UV-space geometry-to-geometry fusion that reduces dependence on dataset-specific appearance and capture conditions. Experiments on various benchmarks show that UVFaceFusion achieves state-of-the-art reconstruction accuracy while reconstructing a mesh from 16 input views in less than 3 seconds on a single RTX 4090. Code is available at https://github.com/grignarder/UVFaceFusion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 46 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
21 of 46 references.
References · 21
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 482
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
- 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
- 2018Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Networkcited by 195
- 2022Towards Metrical Reconstruction of Human Facescited by 166
- 2021H3D-Net: Few-Shot High-Fidelity 3D Head Reconstructioncited by 81
- 2018FML: Face Model Learning from Videoscited by 78
- 2016Learning Detailed Face Reconstruction from a Single Imagecited by 71
- 2017Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translationcited by 56
- 2019MVF-Net: Multi-View 3D Face Morphable Model Regressioncited by 45
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
9 more
- 20233D Face Reconstruction with the Geometric Guidance of Facial Part Segmentationcited by 38
- 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
- 2023MoSAR: Monocular Semi-Supervised Model for Avatar Reconstruction using Differentiable Shadingcited by 18
- 2021Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collectioncited by 16
- 2024EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Headcited by 16
- 2023Implicit Shape and Appearance Priors for Few-Shot Full Head Reconstructioncited by 8
- 2024GRAPE: Generalizable and Robust Multi-view Facial Capturecited by 6
- 2025VGGTFace: Topologically Consistent Facial Geometry Reconstruction in the Wildcited by 4
- 2026Registration-Free Learnable Multi-View Capture of Faces in Dense Semantic Correspondencecited by 1
Built on by
Not cited yet.