D3FlowSLAM: Self-Supervised Dynamic SLAM with Flow Motion Decomposition and DINO Guidance
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce a self-supervised deep SLAM method that robustly operates in dynamic scenes while accurately identifying dynamic components. Our method leverages a dual-flow representation for static flow and dynamic flow, facilitating effective scene decomposition in dynamic environments. We propose a dynamic update module based on this representation and develop a dense SLAM system that excels in dynamic scenarios. In addition, we design a self-supervised training scheme using DINO as a prior, enabling label-free training. Our method achieves superior accuracy compared to other self-supervised methods. It also matches or even surpasses the performance of existing supervised methods in some cases. All code and data will be made publicly available upon acceptance.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 57 of its 104 references that are in the map. First posted on arXiv 18 Jul 2022.
Builds on
57 of 104 references.
References · 57
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Mask R-CNNcited by 7,259
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
38 more
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2016Direct Sparse Odometrycited by 479
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
- 2020Virtual KITTI 2cited by 345
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 241
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
- 2020A survey of loss functions for semantic segmentationcited by 216
- 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
- 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2017Geometry-Aware Learning of Maps for Camera Localizationcited by 161
- 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 130
- 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
- 2019HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Cloudscited by 108
- 2020TartanVO: A Generalizable Learning-based VOcited by 107
- 2018CubeSLAM: Monocular 3D Object SLAMcited by 101
- 2018The TUM VI Benchmark for Evaluating Visual-Inertial Odometrycited by 94
- 2018DS-SLAM: A Semantic Visual SLAM towards Dynamic Environmentscited by 90
- 2018DeepTAM: Deep Tracking and Mappingcited by 87
- 2020UPFlow: Upsampling Pyramid for Unsupervised Optical Flow Learningcited by 49
- 2022Disentangling Object Motion and Occlusion for Unsupervised Multi-frame Monocular Depthcited by 48
- 2021Tangent Space Backpropagation for 3D Transformation Groupscited by 40
- 2018Learning Rigidity in Dynamic Scenes with a Moving Camera for 3D Motion Field Estimationcited by 38
- 2020FlowFusion: Dynamic Dense RGB-D SLAM Based on Optical Flowcited by 36
- 2019EM-Fusion: Dynamic Object-Level SLAM with Probabilistic Data Associationcited by 28
- 2019Mono-SF: Multi-View Geometry Meets Single-View Depth for Monocular Scene Flow Estimation of Dynamic Traffic Scenescited by 27
- 2018Online Temporal Calibration for Monocular Visual-Inertial Systemscited by 26
- 2022PVO: Panoptic Visual Odometrycited by 26
- 2019Direct Sparse Mappingcited by 25
- 2020Dynamic SLAM: The Need For Speedcited by 24
- 2020EffiScene: Efficient Per-Pixel Rigidity Inference for Unsupervised Joint Learning of Optical Flow, Depth, Camera Pose and Motion Segmentationcited by 22
- 2021DF-VO: What Should Be Learnt for Visual Odometry?cited by 22
- 2021LIFT-SLAM: a deep-learning feature-based monocular visual SLAM methodcited by 20
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 5; 2025: 3.
9 papers.
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
- 2024Deep Patch Visual SLAMcited by 68
- 2022iDF-SLAM: End-to-End RGB-D SLAM with Neural Implicit Mapping and Deep Feature Trackingcited by 22
- 2024DynaSurfGS: Dynamic Surface Reconstruction with Planar-based Gaussian Splattingcited by 19
- 2024RoDUS: Robust Decomposition of Static and Dynamic Elements in Urban Scenescited by 14
- 2025DINO-SLAM: DINO-informed RGB-D SLAM for Neural Implicit and Explicit Representationscited by 6
- 2024Salient Sparse Visual Odometry With Pose-Only Supervisioncited by 2
- 2025ProDyG: Progressive Dynamic Scene Reconstruction via Gaussian Splatting from Monocular Videoscited by 1
- 2025Dropping the D: RGB-D SLAM Without the Depth Sensorcited by 0
- 2025Dropping the D: RGB-D SLAM Without the Depth Sensor7 Oct 2025
- 2025ProDyG: Progressive Dynamic Scene Reconstruction via Gaussian Splatting from Monocular Videos22 Sep 2025
- 2025DINO-SLAM: DINO-informed RGB-D SLAM for Neural Implicit and Explicit Representations25 Jul 2025
- 2024DynaSurfGS: Dynamic Surface Reconstruction with Planar-based Gaussian Splatting26 Aug 2024
- 2024Deep Patch Visual SLAM3 Aug 2024
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild29 May 2024
- 2024Salient Sparse Visual Odometry With Pose-Only Supervision6 Apr 2024
- 2024RoDUS: Robust Decomposition of Static and Dynamic Elements in Urban Scenes14 Mar 2024
- 2022iDF-SLAM: End-to-End RGB-D SLAM with Neural Implicit Mapping and Deep Feature Tracking16 Sep 2022