Self-Supervised Geometry-Guided Initialization for Robust Monocular Visual Odometry
Not on the map. Why?
Abstract (arXiv)
Monocular visual odometry is a key technology in various autonomous systems. Traditional feature-based methods suffer from failures due to poor lighting, insufficient texture, and large motions. In contrast, recent learning-based dense SLAM methods exploit iterative dense bundle adjustment to address such failure cases, and achieve robust and accurate localization in a wide variety of real environments, without depending on domain-specific supervision. However, despite its potential, the methods still struggle with scenarios involving large motion and object dynamics. In this study, we diagnose key weaknesses in a popular learning-based dense SLAM model (DROID-SLAM) by analyzing major failure cases on outdoor benchmarks and exposing various shortcomings of its optimization process. We then propose the use of self-supervised priors leveraging a frozen large-scale pre-trained monocular depth estimator to initialize the dense bundle adjustment process, leading to robust visual odometry without the need to fine-tune the SLAM backbone. Despite its simplicity, the proposed method demonstrates significant improvements on KITTI odometry, as well as the challenging DDAD benchmark.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 3 Jun 2024.
Builds on
40 of 49 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015Spatial Transformer Networkscited by 1,423
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
28 more
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2016Direct Sparse Odometrycited by 479
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2020Virtual KITTI 2cited by 345
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
- 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
- 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
- 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
- 20223D Common Corruptions and Data Augmentationcited by 120
- 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
- 2019Visual Odometry Revisited: What Should Be Learnt?cited by 57
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesiscited by 56
- 2023NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenescited by 53
- 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 50
- 2020Pseudo RGB-D for Self-Improving Monocular SLAM and Depth Predictioncited by 41
- 2020Auto-Rectify Network for Unsupervised Indoor Depth Estimationcited by 39
- 2023R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Camerascited by 39
- 2022PVO: Panoptic Visual Odometrycited by 26
- 2019Semi-Supervised Monocular Depth Estimation with Left-Right Consistency Using Deep Neural Networkcited by 21
- 2021Self-Supervised Camera Self-Calibration from Videocited by 17
- 2019Self-Supervised 3D Keypoint Learning for Ego-motion Estimationcited by 12
- 2022MonoIndoor++:Towards Better Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 12
- 2021Deep Online Correction for Monocular Visual Odometrycited by 9
- 2022Performance Guarantees for Spectral Initialization in Rotation Averaging and Pose-Graph SLAMcited by 8
- 2023Robust Self-Supervised Extrinsic Self-Calibrationcited by 4
- 2023AltNeRF: Learning Robust Neural Radiance Field via Alternating Depth-Pose Optimizationcited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025ZeroVO: Visual Odometry with Minimal Assumptionscited by 4
- 2025ZeroVO: Visual Odometry with Minimal Assumptions9 Jun 2025