mlsanityData to 7 Oct 2026

A high-precision self-supervised monocular visual odometry in foggy weather based on robust cycled generative adversarial networks and multi-task learning aided depth estimation

arXiv 2203.04812 ↗First posted 9 Mar 2022cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper proposes a high-precision self-supervised monocular VO, which is specifically designed for navigation in foggy weather. A cycled generative adversarial network is designed to obtain high-quality self-supervised loss via forcing the forward and backward half-cycle to output consistent estimation. Moreover, gradient-based loss and perceptual loss are introduced to eliminate the interference of complex photometric change on self-supervised loss in foggy weather. To solve the ill-posed problem of depth estimation, a self-supervised multi-task learning aided depth estimation module is designed based on the strong correlation between the depth estimation and transmission map calculation of hazy images in foggy weather. The experimental results on the synthetic foggy KITTI dataset show that the proposed self-supervised monocular VO performs better in depth and pose estimation than other state-of-the-art monocular VO in the literature, indicating the designed method is more suitable for foggy weather.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 54 references that are in the map. First posted on arXiv 9 Mar 2022.

Builds on

31 of 54 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2016Least Squares Generative Adversarial Networkscited by 1,000
  3. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  4. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
  5. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  6. 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
  7. 2017Semantic Foggy Scene Understanding with Synthetic Datacited by 401
  8. 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
  9. 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
  10. 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 200
  11. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  12. 2017DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networkscited by 173
19 more
  1. 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
  2. 2016BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Re-integrationcited by 116
  3. 2017UnDeepVO: Monocular Visual Odometry through Unsupervised Deep Learningcited by 95
  4. 2018DeepTAM: Deep Tracking and Mappingcited by 87
  5. 2018Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometrycited by 85
  6. 2020Learning Monocular Visual Odometry via Self-Supervised Long-Term Modelingcited by 39
  7. 2019GN-Net: The Gauss-Newton Loss for Multi-Weather Relocalizationcited by 32
  8. 2017Driven to Distraction: Self-Supervised Distractor Learning for Robust Monocular Visual Odometry in Urban Environmentscited by 22
  9. 2018GANVO: Unsupervised Deep Monocular Visual Odometry and Depth Estimation with Generative Adversarial Networkscited by 21
  10. 2016PsyPhy: A Psychophysics Driven Evaluation Framework for Visual Recognitioncited by 18
  11. 2019Sequential Adversarial Learning for Self-Supervised Deep Visual Odometrycited by 18
  12. 2020Single Image Dehazing Using Ranking Convolutional Neural Networkcited by 12
  13. 2018Geometric Consistency for Self-Supervised End-to-End Visual Odometrycited by 11
  14. 2018A Deeper Insight into the UnDEMoN: Unsupervised Deep Network for Depth and Ego-Motion Estimationcited by 11
  15. 2017Deep EndoVO: A Recurrent Convolutional Neural Network (RCNN) based Visual Odometry Approach for Endoscopic Capsule Robotscited by 10
  16. 2019Ground Plane based Absolute Scale Estimation for Monocular Visual Odometrycited by 10
  17. 2018Learning monocular visual odometry with dense 3D mapping from dense 3D flowcited by 8
  18. 2020Unsupervised Learning of Depth and Ego-Motion from Cylindrical Panoramic Video with Applications for Virtual Realitycited by 4
  19. 2020Masked GANs for Unsupervised Depth and Pose Prediction with Scale Consistencycited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.