mlsanityData to 7 Oct 2026

Topo4D: Topology-Preserving Gaussian Splatting for High-Fidelity 4D Head Capture

arXiv 2406.00440 ↗First posted 1 Jun 2024cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

4D head capture aims to generate dynamic topological meshes and corresponding texture maps from videos, which is widely utilized in movies and games for its ability to simulate facial muscle movements and recover dynamic textures in pore-squeezing. The industry often adopts the method involving multi-view stereo and non-rigid alignment. However, this approach is prone to errors and heavily reliant on time-consuming manual processing by artists. To simplify this process, we propose Topo4D, a novel framework for automatic geometry and texture generation, which optimizes densely aligned 4D heads and 8K texture maps directly from calibrated multi-view time-series images. Specifically, we first represent the time-series faces as a set of dynamic 3D Gaussians with fixed topology in which the Gaussian centers are bound to the mesh vertices. Afterward, we perform alternative geometry and texture optimization frame-by-frame for high-quality geometry and texture learning while maintaining temporal topology stability. Finally, we can extract dynamic facial meshes in regular wiring arrangement and high-fidelity textures with pore-level details from the learned Gaussians. Extensive experiments show that our method achieves superior results than the current SOTA face reconstruction methods both in the quality of meshes and textures. Project page: https://xuanchenli.github.io/Topo4D/.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 51 of its 73 references that are in the map. First posted on arXiv 1 Jun 2024.

Builds on

51 of 73 references.

References · 51

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  8. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  9. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  10. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  11. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  12. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
38 more
  1. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  2. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  3. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  4. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  5. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  6. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  7. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
  8. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  9. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  10. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
  11. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  12. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  13. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  14. 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
  15. 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
  16. 2023Drivable 3D Gaussian Avatarscited by 120
  17. 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
  18. 2020Learning Formation of Physically-Based Face Attributescited by 94
  19. 2020AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"cited by 91
  20. 2023MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatarcited by 89
  21. 2022Multiface: A Dataset for Neural Face Renderingcited by 87
  22. 20223D face reconstruction with dense landmarkscited by 70
  23. 2019Towards a complete 3D morphable model of the human headcited by 63
  24. 2017UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognitioncited by 62
  25. 2020High-Fidelity 3D Digital Human Head Creation from RGB-D Selfiescited by 47
  26. 2019MVF-Net: Multi-View 3D Face Morphable Model Regressioncited by 45
  27. 2023A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Imagescited by 43
  28. 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
  29. 2023HHAvatar: Gaussian Head Avatar with Dynamic Hairscited by 35
  30. 2023Instant Multi-View Head Capture through Learnable Registrationcited by 34
  31. 2023NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Imagescited by 32
  32. 2022AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Trainingcited by 31
  33. 2022DialogueNeRF: Towards Realistic Avatar Face-to-Face Conversation Video Generationcited by 30
  34. 2022Facial Geometric Detail Recovery via Implicit Representationcited by 27
  35. 2021RoI Tanh-polar Transformer Network for Face Parsing in the Wildcited by 23
  36. 2016Fitting a 3D Morphable Model to Edges: A Comparison Between Hard and Soft Correspondencescited by 17
  37. 2022Video-driven Neural Physically-based Facial Asset for Productioncited by 17
  38. 2022Detailed Facial Geometry Recovery from Multi-View Images by Learning an Implicit Functioncited by 14

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.