DDN-SLAM: Real-time Dense Dynamic Neural Implicit SLAM
Not on the map. Why?
Abstract (arXiv)
SLAM systems based on NeRF have demonstrated superior performance in rendering quality and scene reconstruction for static environments compared to traditional dense SLAM. However, they encounter tracking drift and mapping errors in real-world scenarios with dynamic interferences. To address these issues, we introduce DDN-SLAM, the first real-time dense dynamic neural implicit SLAM system integrating semantic features. To address dynamic tracking interferences, we propose a feature point segmentation method that combines semantic features with a mixed Gaussian distribution model. To avoid incorrect background removal, we propose a mapping strategy based on sparse point cloud sampling and background restoration. We propose a dynamic semantic loss to eliminate dynamic occlusions. Experimental results demonstrate that DDN-SLAM is capable of robustly tracking and producing high-quality reconstructions in dynamic environments, while appropriately preserving potential dynamic objects. Compared to existing neural implicit SLAM systems, the tracking results on dynamic datasets indicate an average 90% improvement in Average Trajectory Error (ATE) accuracy.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 60 of its 100 references that are in the map. First posted on arXiv 3 Jan 2024.
Builds on
60 of 100 references.
References · 60
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
38 more
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 180
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2018CodeSLAM - Learning a Compact, Optimisable Representation for Dense Visual SLAMcited by 151
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 130
- 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 121
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2020DeepFactors: Real-Time Probabilistic Dense Monocular SLAMcited by 117
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
- 2018DS-SLAM: A Semantic Visual SLAM towards Dynamic Environmentscited by 90
- 2021LOLNeRF: Learn from One Lookcited by 84
- 2022Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mappingcited by 79
- 2019Autolabeling 3D Objects with Differentiable Rendering of SDF Shape Priorscited by 74
- 2020DI-Fusion: Online Implicit 3D Reconstruction with Deep Priorscited by 70
- 2023vMAP: Vectorised Object Mapping for Neural Field SLAMcited by 67
- 2023PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustmentcited by 62
- 2022NAN: Noise-Aware NeRFs for Burst-Denoisingcited by 48
- 2017Co-Fusion: Real-time Segmentation, Tracking and Fusion of Multiple Objectscited by 47
- 2020DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAMcited by 47
- 2022NeRF-RPN: A general framework for object detection in NeRFscited by 46
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2024: 8; 2025: 9; 2026: 5.
22 papers.
Sort:
By area:
- 2024NeSLAM: Neural Implicit Mapping and Self-Supervised Feature Tracking With Depth Completion and Denoisingcited by 29
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2024Automatic News Generation and Fact-Checking System Based on Language Processingcited by 22
- 2024Evaluating Modern Approaches in 3D Scene Reconstruction: NeRF vs Gaussian-Based Methodscited by 16
- 2024Utilizing Deep Learning to Optimize Software Development Processescited by 15
- 2024Comprehensive Survey of Model Compression and Speed up for Vision Transformerscited by 14
- 2025VPGS-SLAM: Voxel-based Progressive 3D Gaussian SLAM in Large-Scale Scenescited by 12
- 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulationcited by 12
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representationcited by 11
- 2024RoadBEV: Road Surface Reconstruction in Bird's Eye Viewcited by 8
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2024End-To-End Training and Testing Gamification Framework to Learn Human Highway Drivingcited by 1
10 more
- 2024Look Ma, No Ground Truth! Ground-Truth-Free Tuning of Structure from Motion and Visual SLAMcited by 1
- 2025CAD-SLAM: Consistency-Aware Dynamic SLAM with Dynamic-Static Decoupled Mappingcited by 1
- 2025ProDyG: Progressive Dynamic Scene Reconstruction via Gaussian Splatting from Monocular Videoscited by 1
- 2025Dynamic Visual SLAM using a General 3D Priorcited by 1
- 2025Dropping the D: RGB-D SLAM Without the Depth Sensorcited by 0
- 2025ACE-SLAM: Scene Coordinate Regression for Neural Implicit Real-Time SLAMcited by 0
- 2026Efficient Segment Anything with Depth-Aware Fusion and Limited Training Datacited by 0
- 2026RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstructioncited by 0
- 2026RoSe-SLAM: Robust Semantic-Aware Gaussian Splatting SLAM from Dynamic Monocular Videoscited by 0
- 2026SCOUT-SLAM: Structurally-Coupled Dual Uncertainty-Aware 3DGS SLAM in the Wildcited by 0
- 2026SCOUT-SLAM: Structurally-Coupled Dual Uncertainty-Aware 3DGS SLAM in the Wild13 Sep 2026
- 2026RoSe-SLAM: Robust Semantic-Aware Gaussian Splatting SLAM from Dynamic Monocular Videos29 Aug 2026
- 2026RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstruction24 Feb 2026
- 2026Efficient Segment Anything with Depth-Aware Fusion and Limited Training Data12 Feb 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2025ACE-SLAM: Scene Coordinate Regression for Neural Implicit Real-Time SLAM16 Dec 2025
- 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulation8 Dec 2025
- 2025Dynamic Visual SLAM using a General 3D Prior7 Dec 2025
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Models3 Dec 2025
- 2025Dropping the D: RGB-D SLAM Without the Depth Sensor7 Oct 2025
- 2025ProDyG: Progressive Dynamic Scene Reconstruction via Gaussian Splatting from Monocular Videos22 Sep 2025
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representation23 Jun 2025
10 more
- 2025CAD-SLAM: Consistency-Aware Dynamic SLAM with Dynamic-Static Decoupled Mapping26 May 2025
- 2025VPGS-SLAM: Voxel-based Progressive 3D Gaussian SLAM in Large-Scale Scenes25 May 2025
- 2024Look Ma, No Ground Truth! Ground-Truth-Free Tuning of Structure from Motion and Visual SLAM2 Dec 2024
- 2024Evaluating Modern Approaches in 3D Scene Reconstruction: NeRF vs Gaussian-Based Methods8 Aug 2024
- 2024Automatic News Generation and Fact-Checking System Based on Language Processing17 May 2024
- 2024Utilizing Deep Learning to Optimize Software Development Processes21 Apr 2024
- 2024End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving16 Apr 2024
- 2024Comprehensive Survey of Model Compression and Speed up for Vision Transformers16 Apr 2024
- 2024RoadBEV: Road Surface Reconstruction in Bird's Eye View9 Apr 2024
- 2024NeSLAM: Neural Implicit Mapping and Self-Supervised Feature Tracking With Depth Completion and Denoising29 Mar 2024
- 2024NeSLAM: Neural Implicit Mapping and Self-Supervised Feature Tracking With Depth Completion and Denoisingcited by 29
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Modelscited by 29
- 2024Automatic News Generation and Fact-Checking System Based on Language Processingcited by 22
- 2024Evaluating Modern Approaches in 3D Scene Reconstruction: NeRF vs Gaussian-Based Methodscited by 16
- 2024Utilizing Deep Learning to Optimize Software Development Processescited by 15
- 2024Comprehensive Survey of Model Compression and Speed up for Vision Transformerscited by 14
- 2025VPGS-SLAM: Voxel-based Progressive 3D Gaussian SLAM in Large-Scale Scenescited by 12
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representationcited by 11
- 2024RoadBEV: Road Surface Reconstruction in Bird's Eye Viewcited by 8
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2024Look Ma, No Ground Truth! Ground-Truth-Free Tuning of Structure from Motion and Visual SLAMcited by 1
- 2025CAD-SLAM: Consistency-Aware Dynamic SLAM with Dynamic-Static Decoupled Mappingcited by 1
12 most cited of 20 All 20 (JSON)
- 2026SCOUT-SLAM: Structurally-Coupled Dual Uncertainty-Aware 3DGS SLAM in the Wild13 Sep 2026
- 2026RoSe-SLAM: Robust Semantic-Aware Gaussian Splatting SLAM from Dynamic Monocular Videos29 Aug 2026
- 2026RU4D-SLAM: Reweighting Uncertainty in Gaussian Splatting SLAM for 4D Scene Reconstruction24 Feb 2026
- 2026Efficient Segment Anything with Depth-Aware Fusion and Limited Training Data12 Feb 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2025ACE-SLAM: Scene Coordinate Regression for Neural Implicit Real-Time SLAM16 Dec 2025
- 2025Dynamic Visual SLAM using a General 3D Prior7 Dec 2025
- 2025What Is The Best 3D Scene Representation for Robotics? From Geometric to Foundation Models3 Dec 2025
- 2025Dropping the D: RGB-D SLAM Without the Depth Sensor7 Oct 2025
- 2025ProDyG: Progressive Dynamic Scene Reconstruction via Gaussian Splatting from Monocular Videos22 Sep 2025
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representation23 Jun 2025
- 2025CAD-SLAM: Consistency-Aware Dynamic SLAM with Dynamic-Static Decoupled Mapping26 May 2025
12 newest of 20 All 20 (JSON)