RGBDS-SLAM: A RGB-D Semantic Dense SLAM Based on 3D Multi Level Pyramid Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
High-quality reconstruction is crucial for dense SLAM. Recent popular approaches utilize 3D Gaussian Splatting (3D GS) techniques for RGB, depth, and semantic reconstruction of scenes. However, these methods often overlook issues of detail and consistency in different parts of the scene. To address this, we propose RGBDS-SLAM, a RGB-D semantic dense SLAM system based on 3D multi-level pyramid gaussian splatting, which enables high-quality dense reconstruction of scene RGB, depth, and semantics.In this system, we introduce a 3D multi-level pyramid gaussian splatting method that restores scene details by extracting multi-level image pyramids for gaussian splatting training, ensuring consistency in RGB, depth, and semantic reconstructions. Additionally, we design a tightly-coupled multi-features reconstruction optimization mechanism, allowing the reconstruction accuracy of RGB, depth, and semantic maps to mutually enhance each other during the rendering optimization process. Extensive quantitative, qualitative, and ablation experiments on the Replica and ScanNet public datasets demonstrate that our proposed method outperforms current state-of-the-art methods. The open-source code will be available at: https://github.com/zhenzhongcao/RGBDS-SLAM.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 31 of its 36 references that are in the map. First posted on arXiv 2 Dec 2024.
Builds on
31 of 36 references.
References · 31
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2020Neural Sparse Voxel Fieldscited by 959
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2016Direct Sparse Odometrycited by 479
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
19 more
- 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
- 2023Gaussian Splatting SLAMcited by 410
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 152
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 139
- 2024SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAMcited by 86
- 2023SNI-SLAM: Semantic Neural Implicit SLAMcited by 64
- 2024SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAMcited by 41
- 2020FlowFusion: Dynamic Dense RGB-D SLAM Based on Optical Flowcited by 36
- 2023Neural Implicit Dense Semantic SLAMcited by 26
- 2023DNS SLAM: Dense Neural Semantic-Informed SLAMcited by 23
- 2024NEDS-SLAM: A Neural Explicit Dense Semantic SLAM Framework using 3D Gaussian Splattingcited by 16
- 2024IG-SLAM: Instant Gaussian SLAMcited by 6
Built on by
Citing papers per year: 2025: 4; 2026: 2.
6 papers.
- 2025LEG-SLAM: Real-Time Language-Enhanced Gaussian Splatting for SLAMcited by 2
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2025KM-ViPE: Online Tightly Coupled Vision-Language-Geometry Fusion for Open-Vocabulary Semantic SLAMcited by 1
- 2026RADIO-ViPE: Online Tightly Coupled Multi-Modal Fusion for Open-Vocabulary Semantic SLAM in Dynamic Environmentscited by 1
- 2025CUS-GS: A Compact Unified Structured Gaussian Splatting Framework for Multimodal Scene Representationcited by 0
- 2025PCR-ORB: Enhanced ORB-SLAM3 with Point Cloud Refinement Using Deep Learning-Based Dynamic Object Filteringcited by 0
- 2026RADIO-ViPE: Online Tightly Coupled Multi-Modal Fusion for Open-Vocabulary Semantic SLAM in Dynamic Environments28 Apr 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2025PCR-ORB: Enhanced ORB-SLAM3 with Point Cloud Refinement Using Deep Learning-Based Dynamic Object Filtering29 Dec 2025
- 2025KM-ViPE: Online Tightly Coupled Vision-Language-Geometry Fusion for Open-Vocabulary Semantic SLAM1 Dec 2025
- 2025CUS-GS: A Compact Unified Structured Gaussian Splatting Framework for Multimodal Scene Representation22 Nov 2025
- 2025LEG-SLAM: Real-Time Language-Enhanced Gaussian Splatting for SLAM3 Jun 2025