mlsanityData to 14 Oct 2026

UDGS-SLAM : UniDepth Assisted Gaussian Splatting for Monocular SLAM

arXiv 2409.00362 ↗First posted 31 Aug 2024cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advancements in monocular neural depth estimation, particularly those achieved by the UniDepth network, have prompted the investigation of integrating UniDepth within a Gaussian splatting framework for monocular SLAM. This study presents UDGS-SLAM, a novel approach that eliminates the necessity of RGB-D sensors for depth estimation within Gaussian splatting framework. UDGS-SLAM employs statistical filtering to ensure local consistency of the estimated depth and jointly optimizes camera trajectory and Gaussian scene representation parameters. The proposed method achieves high-fidelity rendered images and low ATERMSE of the camera trajectory. The performance of UDGS-SLAM is rigorously evaluated using the TUM RGB-D dataset and benchmarked against several baseline methods, demonstrating superior performance across various scenarios. Additionally, an ablation study is conducted to validate design choices and investigate the impact of different network backbone encoders on system performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 59 references that are in the map. First posted on arXiv 31 Aug 2024.

Builds on

36 of 59 references.

References · 36

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2021Vision Transformers for Dense Predictioncited by 1,803
  3. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  4. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
  5. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
  6. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
  7. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
  8. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  9. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
  10. 2016Direct Sparse Odometrycited by 485
  11. 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
  12. 2023Gaussian Splatting SLAMcited by 415
24 more
  1. 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 411
  2. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
  3. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
  4. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  5. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  6. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  7. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  8. 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
  9. 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
  10. 2017A Survey of Structure from Motioncited by 158
  11. 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 154
  12. 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 153
  13. 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 151
  14. 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
  15. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
  16. 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 107
  17. 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 101
  18. 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 94
  19. 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
  20. 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
  21. 2024RGBD GS-ICP SLAMcited by 65
  22. 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Fieldcited by 61
  23. 2024MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurementscited by 22
  24. 2023Learning a Depth Covariance Functioncited by 16

Built on by

Not cited yet.