mlsanityData to 7 Oct 2026

4D Gaussian Splatting for Real-Time Dynamic Scene Rendering

arXiv 2310.08528 ↗First posted 12 Oct 2023cs.CV cs.GRcited by 1,144

Not on the map. Why?

Cited by 87 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Representing and rendering dynamic scenes has been an important but challenging task. Especially, to accurately model complex motions, high efficiency is usually hard to guarantee. To achieve real-time dynamic scene rendering while also enjoying high training and storage efficiency, we propose 4D Gaussian Splatting (4D-GS) as a holistic representation for dynamic scenes rather than applying 3D-GS for each individual frame. In 4D-GS, a novel explicit representation containing both 3D Gaussians and 4D neural voxels is proposed. A decomposed neural voxel encoding algorithm inspired by HexPlane is proposed to efficiently build Gaussian features from 4D neural voxels and then a lightweight MLP is applied to predict Gaussian deformations at novel timestamps. Our 4D-GS method achieves real-time rendering under high resolutions, 82 FPS at an 800×800 resolution on an RTX 3090 GPU while maintaining comparable or better quality than previous state-of-the-art methods. More demos and code are available at https://guanjunwu.github.io/4dgs/.

Key facts. Cited by 1,144 papers in the map (data through 7 Oct 2026). Builds on 51 of its 80 references that are in the map. First posted on arXiv 12 Oct 2023.

Builds on

51 of 80 references.

References · 51

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  6. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  8. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  9. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  10. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  11. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  12. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
38 more
  1. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  2. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  3. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  4. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  5. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  6. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  7. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  8. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  9. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  10. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  11. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  12. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  13. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  14. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  15. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
  16. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  17. 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 238
  18. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  19. 2018PU-Net: Point Cloud Upsampling Networkcited by 208
  20. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
  21. 2023Robust Dynamic Radiance Fieldscited by 193
  22. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
  23. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
  24. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
  25. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
  26. 2019MeteorNet: Deep Learning on Dynamic 3D Point Cloud Sequencescited by 117
  27. 2023Forward Flow for Novel View Synthesis of Dynamic Scenescited by 67
  28. 2022MonoNeRF: Learning a Generalizable Dynamic Radiance Field from Monocular Videoscited by 63
  29. 2022MPS-NeRF: Generalizable 3D Human Rendering from Multiview Imagescited by 52
  30. 2023Representing Volumetric Videos as Dynamic MLP Mapscited by 51
  31. 2022Approximate Differentiable Rendering with Algebraic Surfacescited by 44
  32. 2022V4d: voxel for 4d novel view synthesiscited by 42
  33. 2022Relighting4D: Neural Relightable Human from Videoscited by 41
  34. 2021HVTR: Hybrid Volumetric-Textural Rendering for Human Avatarscited by 33
  35. 2023Flexible Techniques for Differentiable Rendering with 3D Gaussianscited by 28
  36. 2018Robust 3D Human Motion Reconstruction Via Dynamic Template Constructioncited by 13
  37. 2023GHuNeRF: Generalizable Human NeRF from a Monocular Videocited by 10
  38. 2023Generalizable Neural Voxels for Fast Human Radiance Fieldscited by 8

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 60; 2024: 292; 2025: 423; 2026: 369.

1,144 papers.

Sort:

By area:

  1. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  2. 2023Gaussian Splatting SLAMcited by 410
  3. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  4. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  5. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  6. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  7. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
  8. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  9. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  10. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  11. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  12. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
38 more
  1. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  2. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  3. 2024A Survey on 3D Gaussian Splattingcited by 221
  4. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
  5. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
  6. 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210
  7. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  8. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  9. 2023COLMAP-Free 3D Gaussian Splattingcited by 193
  10. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  11. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
  12. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  13. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  14. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
  15. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  16. 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
  17. 2023Segment Any 3D Gaussianscited by 158
  18. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
  19. 2023HUGS: Human Gaussian Splatscited by 154
  20. 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
  21. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  22. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 143
  23. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  24. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 141
  25. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 139
  26. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  27. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  28. 2024Revising Densification in Gaussian Splattingcited by 127
  29. 2023Relightable Gaussian Codec Avatarscited by 126
  30. 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
  31. 2023GART: Gaussian Articulated Template Modelscited by 121
  32. 2023Drivable 3D Gaussian Avatarscited by 120
  33. 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
  34. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  35. 2024Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collectionscited by 117
  36. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  37. 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
  38. 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 111

50 most cited of 1,144 All 1,144 (JSON)