DSD-GS: Dynamic-Static Decomposition of Gaussian Splatting for Efficient and High-Fidelity Dynamic Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
Dynamic scene reconstruction and novel view synthesis are fundamental to next-generation visual intelligence applications such as virtual reality, robotics, and digital twins. However, high-fidelity reconstruction of complex, time-varying scenes from arbitrary viewpoints remains a significant challenge. Existing dynamic 3DGS methods suffer from computational inefficiency, since they model all Gaussians as dynamic components. While recent decomposition-based approaches address this issue, they still struggle with degraded reconstruction quality and prolonged training time. To mitigate these limitations, we propose a novel dynamic reconstruction framework built upon an efficient static-dynamic decomposition strategy using a Feed-Forward Gaussian Splatting encoder and an optical flow model. By eliminating redundant computations on static regions, our method achieves state-of-the-art performance, outperforming existing baselines across rendering quality, training and rendering speed, and storage efficiency. Notably, on the Neural 3D dataset, our framework requires only 10 minutes for training and achieves a rendering speed of over 700 FPS on a single NVIDIA RTX 5090 GPU at resolution of 1352x1014. Furthermore, our decomposition strategy eliminates the need for COLMAP preprocessing and enables deterministic initialization, thereby enhancing both efficiency and reproducibility.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 49 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
45 of 49 references.
References · 45
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2020Neural Sparse Voxel Fieldscited by 959
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
33 more
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 213
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 152
- 2024FreGS: 3D Gaussian Splatting with Progressive Frequency Regularizationcited by 105
- 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
- 2024Fully Explicit Dynamic Gaussian Splattingcited by 76
- 2024DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenescited by 45
- 2025Swift4D:Adaptive divide-and-conquer Gaussian Splatting for compact and efficient reconstruction of dynamic scenecited by 42
- 2025Instant Gaussian Stream: Fast and Generalizable Streaming of Dynamic Scene Reconstruction via Gaussian Splattingcited by 36
- 2024GaussianSpa: An "Optimizing-Sparsifying" Simplification Framework for Compact and High-Quality 3D Gaussian Splattingcited by 29
- 2024GPS-Gaussian+: Generalizable Pixel-wise 3D Gaussian Splatting for Real-Time Human-Scene Rendering from Sparse Viewscited by 22
- 2025DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstructioncited by 16
- 2024Learnable Infinite Taylor Gaussian for Dynamic View Renderingcited by 11
- 20254DGCPro: Efficient Hierarchical 4D Gaussian Compression for Progressive Volumetric Video Streamingcited by 11
- 2025MoRel: Long-Range Flicker-Free 4D Motion Modeling via Anchor Relay-based Bidirectional Blending with Hierarchical Densificationcited by 1
- 2026MotionScale: Reconstructing Appearance, Geometry, and Motion of Dynamic Scenes with Scalable 4D Gaussian Splattingcited by 1
Built on by
Not cited yet.