mlsanityData to 7 Oct 2026

Self-Supervised Geometry-Guided Initialization for Robust Monocular Visual Odometry

arXiv 2406.00929 ↗First posted 3 Jun 2024cs.CV cs.ROcited by 1

Not on the map. Why?

Abstract (arXiv)

Monocular visual odometry is a key technology in various autonomous systems. Traditional feature-based methods suffer from failures due to poor lighting, insufficient texture, and large motions. In contrast, recent learning-based dense SLAM methods exploit iterative dense bundle adjustment to address such failure cases, and achieve robust and accurate localization in a wide variety of real environments, without depending on domain-specific supervision. However, despite its potential, the methods still struggle with scenarios involving large motion and object dynamics. In this study, we diagnose key weaknesses in a popular learning-based dense SLAM model (DROID-SLAM) by analyzing major failure cases on outdoor benchmarks and exposing various shortcomings of its optimization process. We then propose the use of self-supervised priors leveraging a frozen large-scale pre-trained monocular depth estimator to initialize the dense bundle adjustment process, leading to robust visual odometry without the need to fine-tune the SLAM backbone. Despite its simplicity, the proposed method demonstrates significant improvements on KITTI odometry, as well as the challenging DDAD benchmark.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 3 Jun 2024.

Builds on

40 of 49 references.

References · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  4. 2015Spatial Transformer Networkscited by 1,423
  5. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  6. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  7. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
  8. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  9. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
  10. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  11. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  12. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
28 more
  1. 2021Neural Fields in Visual Computing and Beyondcited by 539
  2. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
  3. 2016Direct Sparse Odometrycited by 479
  4. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
  5. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  6. 2020Virtual KITTI 2cited by 345
  7. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  8. 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
  9. 2022NeRF-SLAM: Real-Time Dense Monocular SLAM with Neural Radiance Fieldscited by 188
  10. 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
  11. 20223D Common Corruptions and Data Augmentationcited by 120
  12. 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
  13. 2019Visual Odometry Revisited: What Should Be Learnt?cited by 57
  14. 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesiscited by 56
  15. 2023NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenescited by 53
  16. 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 50
  17. 2020Pseudo RGB-D for Self-Improving Monocular SLAM and Depth Predictioncited by 41
  18. 2020Auto-Rectify Network for Unsupervised Indoor Depth Estimationcited by 39
  19. 2023R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Camerascited by 39
  20. 2022PVO: Panoptic Visual Odometrycited by 26
  21. 2019Semi-Supervised Monocular Depth Estimation with Left-Right Consistency Using Deep Neural Networkcited by 21
  22. 2021Self-Supervised Camera Self-Calibration from Videocited by 17
  23. 2019Self-Supervised 3D Keypoint Learning for Ego-motion Estimationcited by 12
  24. 2022MonoIndoor++:Towards Better Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 12
  25. 2021Deep Online Correction for Monocular Visual Odometrycited by 9
  26. 2022Performance Guarantees for Spectral Initialization in Rotation Averaging and Pose-Graph SLAMcited by 8
  27. 2023Robust Self-Supervised Extrinsic Self-Calibrationcited by 4
  28. 2023AltNeRF: Learning Robust Neural Radiance Field via Alternating Depth-Pose Optimizationcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.