mlsanityData to 14 Oct 2026

Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis

arXiv 2312.16812 ↗First posted 28 Dec 2023cs.CV cs.GRcited by 344

Not on the map. Why?

Abstract (arXiv)

Novel view synthesis of dynamic scenes has been an intriguing yet challenging problem. Despite recent advancements, simultaneously achieving high-resolution photorealistic results, real-time rendering, and compact storage remains a formidable task. To address these challenges, we propose Spacetime Gaussian Feature Splatting as a novel dynamic scene representation, composed of three pivotal components. First, we formulate expressive Spacetime Gaussians by enhancing 3D Gaussians with temporal opacity and parametric motion/rotation. This enables Spacetime Gaussians to capture static, dynamic, as well as transient content within a scene. Second, we introduce splatted feature rendering, which replaces spherical harmonics with neural features. These features facilitate the modeling of view- and time-dependent appearance while maintaining small size. Third, we leverage the guidance of training error and coarse depth to sample new Gaussians in areas that are challenging to converge with existing pipelines. Experiments on several established real-world datasets demonstrate that our method achieves state-of-the-art rendering quality and speed, while retaining compact storage. At 8K resolution, our lite-version model can render at 60 FPS on an Nvidia RTX 4090 GPU. Our code is available at https://github.com/oppo-us-research/SpacetimeGaussians.

Key facts. Cited by 344 papers in the map (data through 14 Oct 2026). Builds on 77 of its 109 references that are in the map. First posted on arXiv 28 Dec 2023.

Builds on

77 of 109 references.

References · 77

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  8. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  9. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  10. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  11. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  12. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
38 more
  1. 2020Neural Sparse Voxel Fieldscited by 959
  2. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  3. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  4. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  5. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  6. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  7. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
  8. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  9. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
  10. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  11. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  12. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  13. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  14. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  15. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  16. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  17. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 405
  18. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  19. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  20. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  21. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
  22. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
  23. 2019Neural Point-Based Graphicscited by 327
  24. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  25. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  26. 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
  27. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  28. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  29. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  30. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  31. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
  32. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
  33. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
  34. 2023Robust Dynamic Radiance Fieldscited by 194
  35. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 174
  36. 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
  37. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 165
  38. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161

50 most cited of 77 All 77 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 77; 2025: 142; 2026: 125.

344 papers.

Sort:

By area:

  1. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
  2. 2024A Survey on 3D Gaussian Splattingcited by 224
  3. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
  4. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  5. 2024Recent Advances in 3D Gaussian Splattingcited by 131
  6. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
  7. 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
  8. 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
  9. 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 82
  10. 2024AbsGS: Recovering Fine Details for 3D Gaussian Splattingcited by 82
  11. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
  12. 2024Fully Explicit Dynamic Gaussian Splattingcited by 76
38 more
  1. 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 74
  2. 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
  3. 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 63
  4. 2024SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfercited by 61
  5. 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
  6. 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 54
  7. 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
  8. 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
  9. 2024Comp4D: LLM-Guided Compositional 4D Scene Generationcited by 50
  10. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50
  11. 2024Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian Splattingcited by 49
  12. 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 47
  13. 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
  14. 2025Swift4D:Adaptive divide-and-conquer Gaussian Splatting for compact and efficient reconstruction of dynamic scenecited by 42
  15. 2024Deform3DGS: Flexible Deformation for Fast Surgical Scene Reconstruction with Gaussian Splattingcited by 38
  16. 20244D Gaussian Splatting with Scale-aware Residual Field and Adaptive Optimization for Real-time Rendering of Temporally Complex Dynamic Scenescited by 37
  17. 2025Instant Gaussian Stream: Fast and Generalizable Streaming of Dynamic Scene Reconstruction via Gaussian Splattingcited by 36
  18. 2024Dynamic 3D Gaussian Fields for Urban Areascited by 35
  19. 2024DifFRelight: Diffusion-Based Facial Performance Relightingcited by 35
  20. 20254D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Modelscited by 35
  21. 2025MoVieS: Motion-Aware 4D Dynamic View Synthesis in One Secondcited by 35
  22. 2025Trace Anything: Representing Any Video in 4D via Trajectory Fieldscited by 33
  23. 2024SAGD: Boundary-Enhanced Segment Anything in 3D Gaussian via Gaussian Decompositioncited by 30
  24. 2024Robust Dual Gaussian Splatting for Immersive Human-centric Volumetric Videoscited by 30
  25. 2025MoDec-GS: Global-to-Local Motion Decomposition and Temporal Interval Adjustment for Compact Dynamic 3D Gaussian Splattingcited by 30
  26. 2024V^3: Viewing Volumetric Videos on Mobiles via Streamable 2D Dynamic Gaussianscited by 29
  27. 2024Sort-free Gaussian Splatting via Weighted Sum Renderingcited by 29
  28. 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
  29. 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
  30. 2024Lighting Every Darkness with 3DGS: Fast Training and Real-Time Rendering for HDR View Synthesiscited by 27
  31. 20254DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Videocited by 27
  32. 2024GS-Hider: Hiding Messages into 3D Gaussian Splattingcited by 26
  33. 2025StarGen: A Spatiotemporal Autoregression Framework with Video Diffusion Model for Scalable and Controllable Scene Generationcited by 26
  34. 2024Compact 3D Gaussian Splatting for Static and Dynamic Radiance Fieldscited by 25
  35. 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priorscited by 25
  36. 2025CoDa-4DGS: Dynamic Gaussian Splatting with Context and Deformation Awareness for Autonomous Drivingcited by 25
  37. 2024Diffusion2: Dynamic 3D Content Generation via Score Composition of Video and Multi-view Diffusion Modelscited by 24
  38. 2025GIFStream: 4D Gaussian-based Immersive Video with Feature Streamcited by 24

50 most cited of 344 All 344 (JSON)