UDGS-SLAM : UniDepth Assisted Gaussian Splatting for Monocular SLAM
Not on the map. Why?
Abstract (arXiv)
Recent advancements in monocular neural depth estimation, particularly those achieved by the UniDepth network, have prompted the investigation of integrating UniDepth within a Gaussian splatting framework for monocular SLAM. This study presents UDGS-SLAM, a novel approach that eliminates the necessity of RGB-D sensors for depth estimation within Gaussian splatting framework. UDGS-SLAM employs statistical filtering to ensure local consistency of the estimated depth and jointly optimizes camera trajectory and Gaussian scene representation parameters. The proposed method achieves high-fidelity rendered images and low ATERMSE of the camera trajectory. The performance of UDGS-SLAM is rigorously evaluated using the TUM RGB-D dataset and benchmarked against several baseline methods, demonstrating superior performance across various scenarios. Additionally, an ablation study is conducted to validate design choices and investigate the impact of different network backbone encoders on system performance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 59 references that are in the map. First posted on arXiv 31 Aug 2024.
Builds on
36 of 59 references.
References · 36
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2016Direct Sparse Odometrycited by 485
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2023Gaussian Splatting SLAMcited by 415
24 more
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 411
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
- 2023Point-SLAM: Dense Neural Point Cloud-based SLAMcited by 160
- 2017A Survey of Structure from Motioncited by 158
- 2023Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splattingcited by 154
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 153
- 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 151
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 107
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 101
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 94
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2024RGBD GS-ICP SLAMcited by 65
- 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Fieldcited by 61
- 2024MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurementscited by 22
- 2023Learning a Depth Covariance Functioncited by 16
Built on by
Not cited yet.