mlsanityData to 7 Oct 2026

Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstruction

arXiv 2403.11447 ↗First posted 18 Mar 2024cs.CVcited by 100

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information carried by 2D observations, thus suffering from performance degradation and model redundancy. To address the above problem, we propose a novel motion-aware enhancement framework for dynamic scene reconstruction, which mines useful motion cues from optical flow to improve different paradigms of dynamic 3DGS. Specifically, we first establish a correspondence between 3D Gaussian movements and pixel-level flow. Then a novel flow augmentation method is introduced with additional insights into uncertainty and loss collaboration. Moreover, for the prevalent deformation-based paradigm that presents a harder optimization problem, a transient-aware deformation auxiliary module is proposed. We conduct extensive experiments on both multi-view and monocular scenes to verify the merits of our work. Compared with the baselines, our method shows significant superiority in both rendering quality and efficiency.

Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). Builds on 38 of its 53 references that are in the map. First posted on arXiv 18 Mar 2024.

Builds on

38 of 53 references.

References · 38

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2023Segment Anythingcited by 8,158
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  6. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  7. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  8. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  9. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  10. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  11. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  12. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
26 more
  1. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  2. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  3. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  4. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  5. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  6. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  7. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  8. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  9. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  10. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  11. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  12. 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
  13. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  14. 2022Unifying Flow, Stereo and Depth Estimationcited by 270
  15. 2024A Survey on 3D Gaussian Splattingcited by 221
  16. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  17. 2021Neural Articulated Radiance Fieldcited by 196
  18. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
  19. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
  20. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
  21. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
  22. 2018Bounding Box Regression with Uncertainty for Accurate Object Detectioncited by 143
  23. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  24. 2021T"oRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesiscited by 88
  25. 2023A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesiscited by 59
  26. 2023HandNeRF: Neural Radiance Fields for Animatable Interacting Handscited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 25; 2025: 44; 2026: 31.

100 papers.

Sort:

By area:

  1. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  2. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
  3. 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 81
  4. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
  5. 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
  6. 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
  7. 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 53
  8. 2024EG4D: Explicit Generation of 4D Object without Score Distillationcited by 45
  9. 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 45
  10. 2025Deformable Beta Splattingcited by 38
  11. 20254DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Videocited by 26
  12. 20243DGS-CD: 3D Gaussian Splatting-based Change Detection for Physical Object Rearrangementcited by 15
38 more
  1. 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
  2. 2024Dynamics-Aware Gaussian Splatting Streaming Towards Fast On-the-Fly 4D Reconstructioncited by 14
  3. 2024HFGS: 4D Gaussian Splatting with Emphasis on Spatial and Temporal High-Frequency Components for Endoscopic Scene Reconstructioncited by 13
  4. 2024WeatherGS: 3D Scene Reconstruction in Adverse Weather Conditions via Gaussian Splattingcited by 13
  5. 20251000+ FPS 4D Gaussian Splatting for Dynamic Scene Renderingcited by 12
  6. 2025ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenescited by 12
  7. 2024SweepEvGS: Event-Based 3D Gaussian Splatting for Macro and Micro Radiance Field Rendering from a Single Sweepcited by 10
  8. 2025DynaGSLAM: Real-Time Gaussian-Splatting SLAM for Online Rendering, Tracking, Motion Predictions of Moving Objects in Dynamic Scenescited by 10
  9. 2024Mipmap-GS: Let Gaussians Deform with Scale-specific Mipmap for Anti-aliasing Renderingcited by 9
  10. 2024VeGaS: Video Gaussian Splattingcited by 9
  11. 2024TimeFormer: Capturing Temporal Relationships of Deformable 3D Gaussians for Robust Reconstructioncited by 9
  12. 2025GSCodec Studio: A Modular Framework for Gaussian Splat Compressioncited by 9
  13. 2025VoxelSplat: Dynamic Gaussian Splatting as an Effective Loss for Occupancy and Flow Predictioncited by 9
  14. 2025RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformancecited by 8
  15. 2025Light4GS: Lightweight Compact 4D Gaussian Splatting Generation via Context Modelcited by 8
  16. 2024DGNS: Deformable Gaussian Splatting and Dynamic Neural Surface for Monocular Dynamic 3D Reconstructioncited by 7
  17. 2024ResGS: Residual Densification of 3D Gaussian for Efficient Detail Recoverycited by 7
  18. 2025In-2-4D: Inbetweening from Two Single-View Images to 4D Generationcited by 7
  19. 2024Monocular Dynamic Gaussian Splatting: Fast, Brittle, and Scene Complexity Rulescited by 6
  20. 2025D-FCGS: Feedforward Compression of Dynamic Gaussian Splatting for Free-Viewpoint Videoscited by 6
  21. 2025Physics-Informed Deformable Gaussian Splatting: Towards Unified Constitutive Laws for Time-Evolving Material Fieldcited by 6
  22. 2024Adaptive and Temporally Consistent Gaussian Surfels for Multi-view Dynamic Reconstructioncited by 5
  23. 2025PMGS: Reconstruction of Projectile Motion Across Large Spatiotemporal Spans via 3D Gaussian Splattingcited by 5
  24. 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstructioncited by 5
  25. 2026ReconPhys: Reconstruct Appearance and Physical Attributes from Single Videocited by 5
  26. 2025Duplex-GS: Proxy-Guided Weighted Blending for Real-Time Order-Independent Gaussian Splattingcited by 4
  27. 2025Clustered Error Correction with Grouped 4D Gaussian Splattingcited by 4
  28. 20254D Gaussian Splatting as a Learned Dynamical Systemcited by 4
  29. 2025Split4D: Decomposed 4D Scene Reconstruction Without Video Segmentationcited by 4
  30. 20264C4D: 4 Camera 4D Gaussian Splattingcited by 4
  31. 2024Event-boosted Deformable 3D Gaussians for Dynamic Scene Reconstructioncited by 3
  32. 2024RelayGS: Reconstructing Dynamic Scenes with Large-Scale and Complex Motions via Relay Gaussianscited by 3
  33. 2025EvolvingGS: High-Fidelity Streamable Volumetric Video via Evolving 3D Gaussian Representationcited by 3
  34. 2025ImViD: Immersive Volumetric Videos for Enhanced VR Engagementcited by 3
  35. 2025DEGS: Deformable Event-based 3D Gaussian Splatting from RGB and Event Streamcited by 3
  36. 2026Flow4DGS-SLAM: Optical Flow-Guided 4D Gaussian Splatting SLAMcited by 3
  37. 2024Gaussian Splatting Lucas-Kanadecited by 2
  38. 2024AI-Driven Innovations in Volumetric Video Streaming: A Reviewcited by 2

50 most cited of 100 All 100 (JSON)