Topo4D: Topology-Preserving Gaussian Splatting for High-Fidelity 4D Head Capture
Not on the map. Why?
Abstract (arXiv)
4D head capture aims to generate dynamic topological meshes and corresponding texture maps from videos, which is widely utilized in movies and games for its ability to simulate facial muscle movements and recover dynamic textures in pore-squeezing. The industry often adopts the method involving multi-view stereo and non-rigid alignment. However, this approach is prone to errors and heavily reliant on time-consuming manual processing by artists. To simplify this process, we propose Topo4D, a novel framework for automatic geometry and texture generation, which optimizes densely aligned 4D heads and 8K texture maps directly from calibrated multi-view time-series images. Specifically, we first represent the time-series faces as a set of dynamic 3D Gaussians with fixed topology in which the Gaussian centers are bound to the mesh vertices. Afterward, we perform alternative geometry and texture optimization frame-by-frame for high-quality geometry and texture learning while maintaining temporal topology stability. Finally, we can extract dynamic facial meshes in regular wiring arrangement and high-fidelity textures with pore-level details from the learned Gaussians. Extensive experiments show that our method achieves superior results than the current SOTA face reconstruction methods both in the quality of meshes and textures. Project page: https://xuanchenli.github.io/Topo4D/.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 51 of its 73 references that are in the map. First posted on arXiv 1 Jun 2024.
Builds on
51 of 73 references.
References · 51
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
38 more
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
- 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
- 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
- 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
- 2023Drivable 3D Gaussian Avatarscited by 120
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2020Learning Formation of Physically-Based Face Attributescited by 94
- 2020AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"cited by 91
- 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
- 2022Multiface: A Dataset for Neural Face Renderingcited by 87
- 20223D face reconstruction with dense landmarkscited by 70
- 2019Towards a complete 3D morphable model of the human headcited by 63
- 2017UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognitioncited by 62
- 2020High-Fidelity 3D Digital Human Head Creation from RGB-D Selfiescited by 47
- 2019MVF-Net: Multi-View 3D Face Morphable Model Regressioncited by 45
- 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
- 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
- 2023HHAvatar: Gaussian Head Avatar with Dynamic Hairscited by 35
- 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
- 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 32
- 2022AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Trainingcited by 31
- 2022DialogueNeRF: Towards Realistic Avatar Face-to-Face Conversation Video Generationcited by 30
- 2022Facial Geometric Detail Recovery via Implicit Representationcited by 27
- 2021RoI Tanh-polar Transformer Network for Face Parsing in the Wildcited by 23
- 2016Fitting a 3D Morphable Model to Edges: A Comparison Between Hard and Soft Correspondencescited by 17
- 2022Video-driven Neural Physically-based Facial Asset for Productioncited by 17
- 2022Detailed Facial Geometry Recovery from Multi-View Images by Learning an Implicit Functioncited by 14
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2025Towards High-fidelity 3D Talking Avatar with Personalized Dynamic Texturecited by 5
- 2025TagSplat: Topology-Aware Gaussian Splatting for Dynamic Mesh Modeling and Trackingcited by 1
- 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editingcited by 1
- 2026Any3DAvatar: Fast and High-Quality Full-Head 3D Avatar Reconstruction from Single Portrait Imagecited by 1
- 2025Using Gaussian Splats to Create High-Fidelity Facial Geometry and Texturecited by 0
- 2026Representing 3D Faces with Learnable B-Spline Volumescited by 0
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatarscited by 0
- 2026FaceSnap: Real-Time Personalized Lightstage Facial Performance Capturecited by 0
- 2026FaceSnap: Real-Time Personalized Lightstage Facial Performance Capture31 Aug 2026
- 2026Giving Faces Their Feelings Back: Explicit Emotion Control for Feedforward Single-Image 3D Head Avatars16 Apr 2026
- 2026Any3DAvatar: Fast and High-Quality Full-Head 3D Avatar Reconstruction from Single Portrait Image15 Apr 2026
- 2026Representing 3D Faces with Learnable B-Spline Volumes14 Apr 2026
- 2026Feed-forward Gaussian Registration for Head Avatar Creation and Editing16 Mar 2026
- 2025Using Gaussian Splats to Create High-Fidelity Facial Geometry and Texture18 Dec 2025
- 2025TagSplat: Topology-Aware Gaussian Splatting for Dynamic Mesh Modeling and Tracking1 Dec 2025
- 2025Towards High-fidelity 3D Talking Avatar with Personalized Dynamic Texture1 Mar 2025