UnDeepVO: Monocular Visual Odometry through Unsupervised Deep Learning
Not on the map. Why?
Abstract (arXiv)
We propose a novel monocular visual odometry (VO) system called UnDeepVO in this paper. UnDeepVO is able to estimate the 6-DoF pose of a monocular camera and the depth of its view by using deep neural networks. There are two salient features of the proposed UnDeepVO: one is the unsupervised deep learning scheme, and the other is the absolute scale recovery. Specifically, we train UnDeepVO by using stereo image pairs to recover the scale but test it by using consecutive monocular images. Thus, UnDeepVO is a monocular system. The loss function defined for training the networks is based on spatial and temporal dense information. A system overview is shown in Fig. 1. The experiments on KITTI dataset show our UnDeepVO achieves good performance in terms of pose accuracy.
Key facts. Cited by 95 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 29; 2022: 21; 2023: 18; 2024: 11; 2025: 12; 2026: 4.
95 papers.
Sort:
By area:
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
- 2021Monocular 3D Object Detection: An Extrinsic Parameter Free Approachcited by 69
- 2024Deep Patch Visual SLAMcited by 68
- 2022Disentangling Object Motion and Occlusion for Unsupervised Multi-frame Monocular Depthcited by 48
- 2021Full Surround Monodepth from Multiple Camerascited by 41
- 2021Differentiable SLAM-net: Learning Particle SLAM for Visual Navigationcited by 34
- 2022DiffPoseNet: Direct Differentiable Camera Pose Estimationcited by 27
- 2022MGNet: Monocular Geometric Scene Understanding for Autonomous Drivingcited by 27
- 2021Attentive and Contrastive Learning for Joint Depth and Motion Field Estimationcited by 24
- 2022When the Sun Goes Down: Repairing Photometric Losses for All-Day Depth Estimationcited by 24
- 2021DF-VO: What Should Be Learnt for Visual Odometry?cited by 22
38 more
- 2021LIFT-SLAM: a deep-learning feature-based monocular visual SLAM methodcited by 20
- 2023Deep Learning for Camera Calibration and Beyond: A Surveycited by 20
- 2024MAC-VO: Metrics-aware Covariance for Learning-based Stereo Visual Odometrycited by 19
- 2022Improving Monocular Visual Odometry Using Learned Depthcited by 17
- 2023XVO: Generalized Visual Odometry via Cross-Modal Self-Trainingcited by 17
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomycited by 16
- 2021From SLAM to Situational Awareness: Challenges and Surveycited by 14
- 2023iSLAM: Imperative SLAMcited by 14
- 2023Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Networkcited by 14
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2021Advancing Self-supervised Monocular Depth Learning with Sparse LiDARcited by 13
- 2023Lightweight, Uncertainty-Aware Conformalized Visual Odometrycited by 13
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
- 2021Graph-based Thermal-Inertial SLAM with Probabilistic Neural Networkscited by 12
- 2021H-Net: Unsupervised Attention-based Stereo Depth Estimation Leveraging Epipolar Geometrycited by 12
- 2022JPerceiver: Joint Perception Network for Depth, Pose and Layout Estimation in Driving Scenescited by 11
- 2021Self-supervised Visual-LiDAR Odometry with Flip Consistencycited by 9
- 2021Deep Online Correction for Monocular Visual Odometrycited by 9
- 2021Moving SLAM: Fully Unsupervised Deep Learning in Non-Rigid Scenescited by 8
- 2022GeoRefine: Self-Supervised Online Depth Refinement for Accurate Dense Mappingcited by 8
- 2023Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approachcited by 8
- 2024SCIPaD: Incorporating Spatial Clues into Unsupervised Pose-Depth Joint Learningcited by 7
- 2021Unsupervised Learning of Monocular Depth and Ego-Motion Using Multiple Maskscited by 6
- 2021DeepAVO: Efficient Pose Refining with Feature Distilling for Deep Visual Odometrycited by 6
- 2021MotionHint: Self-Supervised Monocular Visual Odometry with Motion Constraintscited by 6
- 2021MDN-VO: Estimating Visual Odometry with Confidencecited by 6
- 2022Robust Self-Supervised LiDAR Odometry via Representative Structure Discovery and 3D Inherent Error Modelingcited by 6
- 2022Self-Supervised Ego-Motion Estimation Based on Multi-Layer Fusion of RGB and Inferred Depthcited by 6
- 2022EMA-VIO: Deep Visual-Inertial Odometry with External Memory Attentioncited by 6
- 2023FMapping: Factorized Efficient Neural Field Mapping for Real-Time Dense RGB SLAMcited by 6
- 2021Unsupervised Joint Learning of Depth, Optical Flow, Ego-motion from Videocited by 5
- 2023Recent Advancements in Deep Learning Applications and Methods for Autonomous Navigation: A Comprehensive Reviewcited by 5
- 2024MambaVO: Deep Visual Odometry Based on Sequential Matching Refinement and Training Smoothingcited by 5
- 2021Unsupervised Monocular Depth Perception: Focusing on Moving Objectscited by 4
- 2022CUAHN-VIO: Content-and-Uncertainty-Aware Homography Network for Visual-Inertial Odometrycited by 4
- 2023Generalizable End-to-End Deep Learning Frameworks for Real-Time Attitude Estimation Using 6DoF Inertial Measurement Unitscited by 4
- 2023Continuous Pose for Monocular Cameras in Neural Implicit Representationcited by 4
- 2024Light-SLAM: A Robust Deep-Learning Visual SLAM System Based on LightGlue under Challenging Lighting Conditionscited by 4
50 most cited of 95 All 95 (JSON)
- 2026DINO-VO: Learning Where to Focus for Enhanced State Estimation5 Apr 2026
- 2026GHOST: Ground-projected Hypotheses from Observed Structure-from-Motion Trajectories21 Mar 2026
- 2026High-Precision 6DOF Pose Estimation via Global Phase Retrieval in Fringe Projection Profilometry for 3D Mapping12 Mar 2026
- 2026OpenVO: Open-World Visual Odometry with Temporal Dynamics Awareness22 Feb 2026
- 2025Discriminately Treating Motion Components Evolves Joint Depth and Ego-Motion Learning3 Nov 2025
- 2025Kinaema: a recurrent sequence model for memory and pose in motion23 Oct 2025
- 2025Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction15 Aug 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025Piggyback Camera: Easy-to-Deploy Visual Surveillance by Mobile Sensing on Commercial Robot Vacuums7 Jul 2025
- 2025What does really matter in image goal navigation?2 Jul 2025
- 2025VOCAL: Visual Odometry via ContrAstive Learning30 Jun 2025
- 2025ZeroVO: Visual Odometry with Minimal Assumptions9 Jun 2025
38 more
- 2025An Online Adaptation Method for Robust Depth Estimation and Visual Odometry in the Open World16 Apr 2025
- 2025SeeTree -- A modular, open-source system for tree detection and orchard localization14 Apr 2025
- 2025Geometry-Constrained Monocular Scale Estimation Using Semantic Segmentation for Dynamic Scenes6 Mar 2025
- 2025Monocular visual simultaneous localization and mapping: (r)evolution from geometry to deep learning-based pipelines4 Mar 2025
- 2024MambaVO: Deep Visual Odometry Based on Sequential Matching Refinement and Training Smoothing28 Dec 2024
- 2024Robust Monocular Visual Odometry using Curriculum Learning20 Nov 2024
- 2024MAC-VO: Metrics-aware Covariance for Learning-based Stereo Visual Odometry14 Sep 2024
- 2024Str-L Pose: Integrating Point and Structured Line for Relative Pose Estimation in Dual-Graph28 Aug 2024
- 2024Deep Patch Visual SLAM3 Aug 2024
- 2024SCIPaD: Incorporating Spatial Clues into Unsupervised Pose-Depth Joint Learning7 Jul 2024
- 2024Imperative Learning: A Self-supervised Neuro-Symbolic Learning Framework for Robot Autonomy23 Jun 2024
- 2024Light-SLAM: A Robust Deep-Learning Visual SLAM System Based on LightGlue under Challenging Lighting Conditions10 May 2024
- 2024An Attention-Based Deep Learning Architecture for Real-Time Monocular Visual Odometry: Applications to GPS-free Drone Navigation27 Apr 2024
- 2024Salient Sparse Visual Odometry With Pose-Only Supervision6 Apr 2024
- 2024Motion Consistency Loss for Monocular Visual Odometry with Attention-Based Deep Learning19 Jan 2024
- 2023GenDepth: Generalizing Monocular Depth Estimation for Arbitrary Camera Parameters via Ground Plane Embedding10 Dec 2023
- 2023Continuous Pose for Monocular Cameras in Neural Implicit Representation28 Nov 2023
- 2023XVO: Generalized Visual Odometry via Cross-Modal Self-Training28 Sep 2023
- 2023Attention-Guided Lidar Segmentation and Odometry Using Image-to-Point Cloud Saliency Transfer28 Aug 2023
- 2023Deep Learning for Visual Localization and Mapping: A Survey27 Aug 2023
- 2023Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Network10 Aug 2023
- 2023A survey on deep learning approaches for data integration in autonomous driving system17 Jun 2023
- 2023iSLAM: Imperative SLAM13 Jun 2023
- 2023FMapping: Factorized Efficient Neural Field Mapping for Real-Time Dense RGB SLAM1 Jun 2023
- 2023Transformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach10 May 2023
- 20233 Dimensional Dense Reconstruction: A Review of Algorithms and Dataset19 Apr 2023
- 2023Pose Constraints for Consistent Self-supervised Monocular Depth and Ego-motion18 Apr 2023
- 2023Improving Neural Radiance Fields with Depth-aware Optimization for Novel View Synthesis11 Apr 2023
- 2023Deep Learning for Camera Calibration and Beyond: A Survey19 Mar 2023
- 2023Lightweight, Uncertainty-Aware Conformalized Visual Odometry3 Mar 2023
- 2023Recent Advancements in Deep Learning Applications and Methods for Autonomous Navigation: A Comprehensive Review22 Feb 2023
- 2023Generalizable End-to-End Deep Learning Frameworks for Real-Time Attitude Estimation Using 6DoF Inertial Measurement Units13 Feb 2023
- 2023DepthP+P: Metric Accurate Monocular Depth Estimation using Planar and Parallax5 Jan 2023
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fields21 Nov 2022
- 2022EMA-VIO: Deep Visual-Inertial Odometry with External Memory Attention18 Sep 2022
- 2022Pseudo-LiDAR for Visual Odometry4 Sep 2022
- 2022CUAHN-VIO: Content-and-Uncertainty-Aware Homography Network for Visual-Inertial Odometry30 Aug 2022
- 2022Neural Camera Models27 Aug 2022
50 newest of 95 All 95 (JSON)
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
- 2021Monocular 3D Object Detection: An Extrinsic Parameter Free Approachcited by 69
- 2024Deep Patch Visual SLAMcited by 68
- 2022Disentangling Object Motion and Occlusion for Unsupervised Multi-frame Monocular Depthcited by 48
- 2021Full Surround Monodepth from Multiple Camerascited by 41
- 2021Differentiable SLAM-net: Learning Particle SLAM for Visual Navigationcited by 34
- 2022DiffPoseNet: Direct Differentiable Camera Pose Estimationcited by 27
- 2022MGNet: Monocular Geometric Scene Understanding for Autonomous Drivingcited by 27
- 2021Attentive and Contrastive Learning for Joint Depth and Motion Field Estimationcited by 24
- 2022When the Sun Goes Down: Repairing Photometric Losses for All-Day Depth Estimationcited by 24
- 2021DF-VO: What Should Be Learnt for Visual Odometry?cited by 22
12 most cited of 92 All 92 (JSON)
- 2026DINO-VO: Learning Where to Focus for Enhanced State Estimation5 Apr 2026
- 2026GHOST: Ground-projected Hypotheses from Observed Structure-from-Motion Trajectories21 Mar 2026
- 2026High-Precision 6DOF Pose Estimation via Global Phase Retrieval in Fringe Projection Profilometry for 3D Mapping12 Mar 2026
- 2026OpenVO: Open-World Visual Odometry with Temporal Dynamics Awareness22 Feb 2026
- 2025Discriminately Treating Motion Components Evolves Joint Depth and Ego-Motion Learning3 Nov 2025
- 2025Kinaema: a recurrent sequence model for memory and pose in motion23 Oct 2025
- 2025Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction15 Aug 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025Piggyback Camera: Easy-to-Deploy Visual Surveillance by Mobile Sensing on Commercial Robot Vacuums7 Jul 2025
- 2025What does really matter in image goal navigation?2 Jul 2025
- 2025VOCAL: Visual Odometry via ContrAstive Learning30 Jun 2025
- 2025ZeroVO: Visual Odometry with Minimal Assumptions9 Jun 2025
12 newest of 92 All 92 (JSON)