mlsanityData to 7 Oct 2026

Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting

arXiv 2310.10642 ↗First posted 16 Oct 2023cs.CVcited by 470

Not on the map. Why?

Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene Structure: Existing methods struggle to reveal the spatial and temporal structure of dynamic scenes from directly learning the complex 6D plenoptic function. (ii) Scaling Deformation Modeling: Explicitly modeling scene element deformation becomes impractical for complex dynamics. To address these issues, we consider the spacetime as an entirety and propose to approximate the underlying spatio-temporal 4D volume of a dynamic scene by optimizing a collection of 4D primitives, with explicit geometry and appearance modeling. Learning to optimize the 4D primitives enables us to synthesize novel views at any desired time with our tailored rendering routine. Our model is conceptually simple, consisting of a 4D Gaussian parameterized by anisotropic ellipses that can rotate arbitrarily in space and time, as well as view-dependent and time-evolved appearance represented by the coefficient of 4D spherindrical harmonics. This approach offers simplicity, flexibility for variable-length video and end-to-end training, and efficient real-time rendering, making it suitable for capturing complex dynamic scene motions. Experiments across various benchmarks, including monocular and multi-view scenarios, demonstrate our 4DGS model's superior visual quality and efficiency.

Key facts. Cited by 470 papers in the map (data through 7 Oct 2026). Builds on 30 of its 39 references that are in the map. First posted on arXiv 16 Oct 2023.

Builds on

30 of 39 references.

References · 30

  1. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  6. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  7. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  8. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  9. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  10. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  11. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  12. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
18 more
  1. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  2. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  3. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  4. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  5. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  6. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  7. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  8. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  9. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  10. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
  11. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
  12. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
  13. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
  14. 2022EfficientNeRF: Efficient Neural Radiance Fieldscited by 110
  15. 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
  16. 2023Factor Fields: A Unified Framework for Neural Fields and Beyondcited by 58
  17. 2022V4d: voxel for 4d novel view synthesiscited by 42
  18. 2022ParticleNeRF: A Particle-Based Encoding for Online Neural Radiance Fieldscited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 29; 2024: 132; 2025: 182; 2026: 127.

470 papers.

Sort:

By area:

  1. 2023Gaussian Splatting SLAMcited by 410
  2. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  3. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  4. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  5. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  6. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  7. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  8. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  9. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  10. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  11. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  12. 2024A Survey on 3D Gaussian Splattingcited by 221
38 more
  1. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
  2. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  3. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  4. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
  5. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
  6. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  7. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
  8. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
  9. 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
  10. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  11. 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 141
  12. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  13. 2024Revising Densification in Gaussian Splattingcited by 127
  14. 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
  15. 2023GART: Gaussian Articulated Template Modelscited by 121
  16. 2023Drivable 3D Gaussian Avatarscited by 120
  17. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  18. 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 111
  19. 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 106
  20. 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
  21. 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
  22. 20243D Gaussian as a New Era: A Surveycited by 102
  23. 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
  24. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  25. 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 97
  26. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
  27. 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
  28. 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 92
  29. 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
  30. 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 81
  31. 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 78
  32. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78
  33. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
  34. 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
  35. 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 73
  36. 2024TAPVid-3D: A Benchmark for Tracking Any Point in 3Dcited by 69
  37. 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 68
  38. 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62

50 most cited of 470 All 470 (JSON)