Flow4DGS-SLAM: Optical Flow-Guided 4D Gaussian Splatting SLAM
Not on the map. Why?
Abstract (arXiv)
Handling the dynamic environments is a significant research challenge in Visual Simultaneous Localization and Mapping (SLAM). Recent research combines 3D Gaussian Splatting (3DGS) with SLAM to achieve both robust camera pose estimation and photorealistic renderings. However, using SLAM to efficiently reconstruct both static and dynamic regions remains challenging. In this work, we propose an efficient framework for dynamic 3DGS SLAM guided by optical flow. Using the input depth and prior optical flow, we first propose a category-agnostic motion mask generation strategy by fitting a camera ego-motion model to decompose the optical flow. This module separates dynamic and static Gaussians and simultaneously provides flow-guided camera pose initialization. We boost the training speed of dynamic 3DGS by explicitly modeling their temporal centers at keyframes. These centers are propagated using 3D scene flow priors and are dynamically initialized with an adaptive insertion strategy. Alongside this, we model the temporal opacity and rotation using a Gaussian Mixture Model (GMM) to adaptively learn the complex dynamics. The empirical results demonstrate our state-of-the-art performance in tracking, dynamic reconstruction, and training efficiency.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 24 Apr 2026.
Builds on
45 of 55 references.
References · 45
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
33 more
- 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 425
- 2023Gaussian Splatting SLAMcited by 415
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 201
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 184
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 154
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 138
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 134
- 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 97
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2018DS-SLAM: A Semantic Visual SLAM towards Dynamic Environmentscited by 91
- 2024FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenescited by 89
- 2018DeepTAM: Deep Tracking and Mappingcited by 87
- 2024Improving 2D Feature Representations by 3D-Aware Fine-Tuningcited by 71
- 2024VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstructioncited by 50
- 2025WildGS-SLAM: Monocular Gaussian Splatting SLAM in Dynamic Environmentscited by 50
- 2024GFlow: Recovering 4D World from Monocular Videocited by 46
- 2020VDO-SLAM: A Visual Dynamic Object-aware SLAM Systemcited by 40
- 2024DG-SLAM: Robust Dynamic Gaussian Splatting SLAM with Hybrid Pose Optimizationcited by 29
- 2024RoDyn-SLAM: Robust Dynamic Dense RGB-D SLAM with Neural Radiance Fieldscited by 22
- 2025FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstructioncited by 15
- 2024DGS-SLAM: Gaussian Splatting SLAM in Dynamic Environmentcited by 10
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026E-WAVE: Event-based Continuous Optical Flow via Warping-Aligned Visual Encoding28 Sep 2026
- 2026VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation11 Sep 2026
- 20264DGS-WAM: Bridging Past and Future with an Object-Centric World Action Model based on 4D Gaussian Splatting26 Aug 2026