Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information carried by 2D observations, thus suffering from performance degradation and model redundancy. To address the above problem, we propose a novel motion-aware enhancement framework for dynamic scene reconstruction, which mines useful motion cues from optical flow to improve different paradigms of dynamic 3DGS. Specifically, we first establish a correspondence between 3D Gaussian movements and pixel-level flow. Then a novel flow augmentation method is introduced with additional insights into uncertainty and loss collaboration. Moreover, for the prevalent deformation-based paradigm that presents a harder optimization problem, a transient-aware deformation auxiliary module is proposed. We conduct extensive experiments on both multi-view and monocular scenes to verify the merits of our work. Compared with the baselines, our method shows significant superiority in both rendering quality and efficiency.
Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). Builds on 38 of its 53 references that are in the map. First posted on arXiv 18 Mar 2024.
Builds on
38 of 53 references.
References · 38
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
26 more
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 301
- 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2021Neural Articulated Radiance Fieldcited by 196
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
- 2018Bounding Box Regression with Uncertainty for Accurate Object Detectioncited by 143
- 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
- 2021T"oRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesiscited by 88
- 2023A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesiscited by 59
- 2023HandNeRF: Neural Radiance Fields for Animatable Interacting Handscited by 27
Built on by
Citing papers per year: 2024: 25; 2025: 44; 2026: 31.
100 papers.
Sort:
By area:
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
- 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 81
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
- 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 53
- 2024EG4D: Explicit Generation of 4D Object without Score Distillationcited by 45
- 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 45
- 2025Deformable Beta Splattingcited by 38
- 20254DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Videocited by 26
- 20243DGS-CD: 3D Gaussian Splatting-based Change Detection for Physical Object Rearrangementcited by 15
38 more
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
- 2024Dynamics-Aware Gaussian Splatting Streaming Towards Fast On-the-Fly 4D Reconstructioncited by 14
- 2024HFGS: 4D Gaussian Splatting with Emphasis on Spatial and Temporal High-Frequency Components for Endoscopic Scene Reconstructioncited by 13
- 2024WeatherGS: 3D Scene Reconstruction in Adverse Weather Conditions via Gaussian Splattingcited by 13
- 20251000+ FPS 4D Gaussian Splatting for Dynamic Scene Renderingcited by 12
- 2025ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenescited by 12
- 2024SweepEvGS: Event-Based 3D Gaussian Splatting for Macro and Micro Radiance Field Rendering from a Single Sweepcited by 10
- 2025DynaGSLAM: Real-Time Gaussian-Splatting SLAM for Online Rendering, Tracking, Motion Predictions of Moving Objects in Dynamic Scenescited by 10
- 2024Mipmap-GS: Let Gaussians Deform with Scale-specific Mipmap for Anti-aliasing Renderingcited by 9
- 2024VeGaS: Video Gaussian Splattingcited by 9
- 2024TimeFormer: Capturing Temporal Relationships of Deformable 3D Gaussians for Robust Reconstructioncited by 9
- 2025GSCodec Studio: A Modular Framework for Gaussian Splat Compressioncited by 9
- 2025VoxelSplat: Dynamic Gaussian Splatting as an Effective Loss for Occupancy and Flow Predictioncited by 9
- 2025RePerformer: Immersive Human-centric Volumetric Videos from Playback to Photoreal Reperformancecited by 8
- 2025Light4GS: Lightweight Compact 4D Gaussian Splatting Generation via Context Modelcited by 8
- 2024DGNS: Deformable Gaussian Splatting and Dynamic Neural Surface for Monocular Dynamic 3D Reconstructioncited by 7
- 2024ResGS: Residual Densification of 3D Gaussian for Efficient Detail Recoverycited by 7
- 2025In-2-4D: Inbetweening from Two Single-View Images to 4D Generationcited by 7
- 2024Monocular Dynamic Gaussian Splatting: Fast, Brittle, and Scene Complexity Rulescited by 6
- 2025D-FCGS: Feedforward Compression of Dynamic Gaussian Splatting for Free-Viewpoint Videoscited by 6
- 2025Physics-Informed Deformable Gaussian Splatting: Towards Unified Constitutive Laws for Time-Evolving Material Fieldcited by 6
- 2024Adaptive and Temporally Consistent Gaussian Surfels for Multi-view Dynamic Reconstructioncited by 5
- 2025PMGS: Reconstruction of Projectile Motion Across Large Spatiotemporal Spans via 3D Gaussian Splattingcited by 5
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstructioncited by 5
- 2026ReconPhys: Reconstruct Appearance and Physical Attributes from Single Videocited by 5
- 2025Duplex-GS: Proxy-Guided Weighted Blending for Real-Time Order-Independent Gaussian Splattingcited by 4
- 2025Clustered Error Correction with Grouped 4D Gaussian Splattingcited by 4
- 20254D Gaussian Splatting as a Learned Dynamical Systemcited by 4
- 2025Split4D: Decomposed 4D Scene Reconstruction Without Video Segmentationcited by 4
- 20264C4D: 4 Camera 4D Gaussian Splattingcited by 4
- 2024Event-boosted Deformable 3D Gaussians for Dynamic Scene Reconstructioncited by 3
- 2024RelayGS: Reconstructing Dynamic Scenes with Large-Scale and Complex Motions via Relay Gaussianscited by 3
- 2025EvolvingGS: High-Fidelity Streamable Volumetric Video via Evolving 3D Gaussian Representationcited by 3
- 2025ImViD: Immersive Volumetric Videos for Enhanced VR Engagementcited by 3
- 2025DEGS: Deformable Event-based 3D Gaussian Splatting from RGB and Event Streamcited by 3
- 2026Flow4DGS-SLAM: Optical Flow-Guided 4D Gaussian Splatting SLAMcited by 3
- 2024Gaussian Splatting Lucas-Kanadecited by 2
- 2024AI-Driven Innovations in Volumetric Video Streaming: A Reviewcited by 2
50 most cited of 100 All 100 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026DispFlow-GS: Displacement Flow Supervision with Motion Disentangling for Monocular Deformable 3D Gaussian Splatting29 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026Tele360: Real-Time Feed-Forward Human Reconstruction from Sparse Unposed Cameras14 Sep 2026
- 2026UniFusion: Sparse-View 4D Reconstruction via Unified Spatio-temporal Depth Alignment5 Sep 2026
- 2026CC-4DGS: Computational Deformation and Point-Cloud Compression for Storage-Efficient Dynamic Gaussian Splatting2 Sep 2026
- 2026Towards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering22 Aug 2026
- 2026DyG2T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer19 Aug 2026
- 2026D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting3 Aug 2026
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis2 Jul 2026
- 2026Learning Efficient 4D Gaussian Representations from Monocular Videos with Flow Splatting29 Jun 2026
- 2026Beyond Static Gaussians: An Empirical Investigation of Architectural Paradigms for Dynamic 3D Scene Reconstruction30 May 2026
38 more
- 2026PaMoSplat: Part-Aware Motion-Guided Gaussian Splatting for Dynamic Scene Reconstruction11 May 2026
- 2026FreeTimeGS++: Secrets of Dynamic Gaussian Splatting and Their Principles5 May 2026
- 2026Flow4DGS-SLAM: Optical Flow-Guided 4D Gaussian Splatting SLAM24 Apr 2026
- 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstruction22 Apr 2026
- 2026Realizing Immersive Volumetric Video: A Multimodal Framework for 6-DoF VR Engagement10 Apr 2026
- 2026ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video9 Apr 2026
- 20264C4D: 4 Camera 4D Gaussian Splatting5 Apr 2026
- 2026GP-4DGS: Probabilistic 4D Gaussian Splatting from Monocular Video via Variational Gaussian Processes3 Apr 2026
- 2026Learning Explicit Continuous Motion Representation for Dynamic Gaussian Splatting from Monocular Videos26 Mar 2026
- 20264D Synchronized Fields: Motion-Language Gaussian Splatting for Temporal Scene Understanding15 Mar 2026
- 2026RetimeGS: Continuous-Time Reconstruction of 4D Gaussian Splatting14 Mar 2026
- 2026Node-RF: Learning Generalized Continuous Space-Time Scene Dynamics with Neural ODE-based NeRFs12 Mar 2026
- 2026GSStream: 3D Gaussian Splatting based Volumetric Scene Streaming System10 Mar 2026
- 2026Sapling-NeRF: Geo-Localised Sapling Reconstruction in Forests for Ecological Monitoring26 Feb 2026
- 2026M-Gaussian: An Magnetic Gaussian Framework for Efficient Multi-Stack MRI Reconstruction24 Feb 2026
- 2026ShapeGaussian: High-Fidelity 4D Human Reconstruction in Monocular Videos via Vision Priors5 Feb 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2026SharpTimeGS: Sharp and Stable Dynamic Gaussian Splatting via Lifespan Modulation3 Feb 2026
- 2026HPC: Hierarchical Point-based Latent Representation for Streaming Dynamic Gaussian Splatting Compression31 Jan 2026
- 2025Split4D: Decomposed 4D Scene Reconstruction Without Video Segmentation28 Dec 2025
- 20254D Gaussian Splatting as a Learned Dynamical System22 Dec 2025
- 2025Tessellation GS: Neural Mesh Gaussians for Robust Monocular Reconstruction of Dynamic Objects8 Dec 2025
- 2025Clustered Error Correction with Grouped 4D Gaussian Splatting20 Nov 2025
- 2025Dynamic Avatar-Scene Rendering from Human-centric Context13 Nov 2025
- 2025Physics-Informed Deformable Gaussian Splatting: Towards Unified Constitutive Laws for Time-Evolving Material Field9 Nov 2025
- 2025Splatography: Sparse multi-view dynamic Gaussian Splatting for filmmaking challenges7 Nov 2025
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstruction14 Oct 2025
- 2025Dynamic Gaussian Splatting from Defocused and Motion-blurred Monocular Videos12 Oct 2025
- 2025DEGS: Deformable Event-based 3D Gaussian Splatting from RGB and Event Stream9 Oct 2025
- 20254DGS-Craft: Consistent and Interactive 4D Gaussian Splatting Editing2 Oct 2025
- 2025ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenes29 Sep 2025
- 2025Rigidity-Aware 3D Gaussian Deformation from a Single Image26 Sep 2025
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video22 Sep 2025
- 20254D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compression22 Sep 2025
- 2025Scale-GS: Efficient Scalable Gaussian Splatting via Redundancy-filtering Training on Streaming Content29 Aug 2025
- 2025Refining Gaussian Splatting: A Volumetric Densification Approach7 Aug 2025
- 2025DET-GS: Depth- and Edge-Aware Regularization for High-Fidelity 3D Gaussian Splatting6 Aug 2025
- 2025Duplex-GS: Proxy-Guided Weighted Blending for Real-Time Order-Independent Gaussian Splatting5 Aug 2025
50 newest of 100 All 100 (JSON)
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
- 2024Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splattingcited by 81
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 62
- 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 53
- 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 45
- 2025Deformable Beta Splattingcited by 38
- 20254DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Videocited by 26
- 20243DGS-CD: 3D Gaussian Splatting-based Change Detection for Physical Object Rearrangementcited by 15
- 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
12 most cited of 98 All 98 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026DispFlow-GS: Displacement Flow Supervision with Motion Disentangling for Monocular Deformable 3D Gaussian Splatting29 Sep 2026
- 2026ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera26 Sep 2026
- 2026Tele360: Real-Time Feed-Forward Human Reconstruction from Sparse Unposed Cameras14 Sep 2026
- 2026UniFusion: Sparse-View 4D Reconstruction via Unified Spatio-temporal Depth Alignment5 Sep 2026
- 2026CC-4DGS: Computational Deformation and Point-Cloud Compression for Storage-Efficient Dynamic Gaussian Splatting2 Sep 2026
- 2026Towards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering22 Aug 2026
- 2026DyG2T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer19 Aug 2026
- 2026D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting3 Aug 2026
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis2 Jul 2026
- 2026Learning Efficient 4D Gaussian Representations from Monocular Videos with Flow Splatting29 Jun 2026
- 2026Beyond Static Gaussians: An Empirical Investigation of Architectural Paradigms for Dynamic 3D Scene Reconstruction30 May 2026
12 newest of 98 All 98 (JSON)