MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization
Not on the map. Why?
Abstract (arXiv)
This letter introduces a novel framework for dense Visual Simultaneous Localization and Mapping (VSLAM) based on Gaussian Splatting. Recently, SLAM based on Gaussian Splatting has shown promising results. However, in monocular scenarios, the Gaussian maps reconstructed lack geometric accuracy and exhibit weaker tracking capability. To address these limitations, we jointly optimize sparse visual odometry tracking and 3D Gaussian Splatting scene representation for the first time. We obtain depth maps on visual odometry keyframe windows using a fast Multi-View Stereo (MVS) network for the geometric supervision of Gaussian maps. Furthermore, we propose a depth smooth loss and Sparse-Dense Adjustment Ring (SDAR) to reduce the negative effect of estimated depth maps and preserve the consistency in scale between the visual odometry and Gaussian maps. We have evaluated our system across various synthetic and real-world datasets. The accuracy of our pose estimation surpasses existing methods and achieves state-of-the-art. Additionally, it outperforms previous monocular methods in terms of novel view synthesis and geometric reconstruction fidelities.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 30 of its 41 references that are in the map. First posted on arXiv 10 May 2024.
Builds on
30 of 41 references.
References · 30
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2016Direct Sparse Odometrycited by 479
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2023Gaussian Splatting SLAMcited by 410
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
18 more
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2022Deep Patch Visual Odometrycited by 186
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 139
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 132
- 2023PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustmentcited by 62
- 2024Loopy-SLAM: Dense Neural SLAM with Loop Closurescited by 48
- 2023HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fieldscited by 31
- 2024NeSLAM: Neural Implicit Mapping and Self-Supervised Feature Tracking With Depth Completion and Denoisingcited by 29
- 2021CodeMapping: Real-Time Dense Mapping for Sparse SLAM using Compact Scene Representationscited by 16
- 2022Probabilistic Volumetric Fusion for Dense Monocular SLAMcited by 16
- 2024NGM-SLAM: Gaussian Splatting SLAM with Radiance Field Submapcited by 8
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 3.
10 papers.
- 2024HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstructioncited by 24
- 2025Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian Pointmapscited by 21
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenescited by 16
- 2025VINGS-Mono: Visual-Inertial Gaussian Splatting Monocular SLAM in Large Scenescited by 11
- 2025Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB Videoscited by 10
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2025TVG-SLAM: Robust Gaussian Splatting SLAM with Tri-view Geometric Constraintscited by 1
- 2024XRDSLAM: A Flexible and Modular Framework for Deep Learning based SLAMcited by 0
- 2026Robust and Efficient Monocular 3D Gaussian SLAM for Kilometer-Scale Outdoor Scenescited by 0
- 2026RawSLAM: Online HDR Gaussian SLAM from Linear Radiancecited by 0
- 2026RawSLAM: Online HDR Gaussian SLAM from Linear Radiance17 Sep 2026
- 2026Robust and Efficient Monocular 3D Gaussian SLAM for Kilometer-Scale Outdoor Scenes29 Jun 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2025Ov3R: Open-Vocabulary Semantic 3D Reconstruction from RGB Videos29 Jul 2025
- 2025Outdoor Monocular SLAM with Global Scale-Consistent 3D Gaussian Pointmaps4 Jul 2025
- 2025TVG-SLAM: Robust Gaussian Splatting SLAM with Tri-view Geometric Constraints29 Jun 2025
- 2025RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes21 Feb 2025
- 2025VINGS-Mono: Visual-Inertial Gaussian Splatting Monocular SLAM in Large Scenes14 Jan 2025
- 2024HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstruction27 Nov 2024
- 2024XRDSLAM: A Flexible and Modular Framework for Deep Learning based SLAM31 Oct 2024