Unsupervised Monocular Depth Estimation in Highly Complex Environments
Not on the map. Why?
Abstract (arXiv)
With the development of computational intelligence algorithms, unsupervised monocular depth and pose estimation framework, which is driven by warped photometric consistency, has shown great performance in the daytime scenario. While in some challenging environments, like night and rainy night, the essential photometric consistency hypothesis is untenable because of the complex lighting and reflection, so that the above unsupervised framework cannot be directly applied to these complex scenarios. In this paper, we investigate the problem of unsupervised monocular depth estimation in highly complex scenarios and address this challenging problem by adopting an image transfer-based domain adaptation framework. We adapt the depth model trained on day-time scenarios to be applicable to night-time scenarios, and constraints on both feature space and output space promote the framework to learn the key features for depth decoding. Meanwhile, we further tackle the effects of unstable image transfer quality on domain adaptation, and an image adaptation approach is proposed to evaluate the quality of transferred images and re-weight the corresponding losses, so as to improve the performance of the adapted depth model. Extensive experiments show the effectiveness of the proposed unsupervised framework in estimating the dense depth map from highly complex images.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 41 of its 65 references that are in the map. First posted on arXiv 28 Jul 2021.
Builds on
41 of 65 references.
References · 41
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Improved Techniques for Training GANscited by 2,938
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2016Direct Sparse Odometrycited by 479
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2018A Survey of Unsupervised Deep Domain Adaptationcited by 361
- 2020A Survey on Neural Network Interpretabilitycited by 291
- 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
29 more
- 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2017Learning Depth from Monocular Videos using Direct Methodscited by 154
- 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
- 2019Diversify and Match: A Domain Adaptive Representation Learning Paradigm for Object Detectioncited by 122
- 2020Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volumecited by 116
- 2020CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistencycited by 107
- 2015A Deeper Look at Dataset Biascited by 86
- 2021Unsupervised Multi-source Domain Adaptation Without Access to Source Datacited by 76
- 2018Fully Convolutional Adaptation Networks for Semantic Segmentationcited by 75
- 2020Monocular Depth Estimation Based On Deep Learning: An Overviewcited by 68
- 2019Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimationcited by 61
- 2020DeFeat-Net: General Monocular Depth via Simultaneous Unsupervised Representation Learningcited by 60
- 2021Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistencycited by 58
- 2018AdaDepth: Unsupervised Content Congruent Adaptation for Depth Estimationcited by 54
- 2019Unsupervised Monocular Depth and Ego-motion Learning with Structure and Semanticscited by 49
- 2021Multi-Source Domain Adaptation with Collaborative Learning for Semantic Segmentationcited by 44
- 2021DRANet: Disentangling Representation and Adaptation Networks for Unsupervised Cross-Domain Adaptationcited by 37
- 2021Curriculum Graph Co-Teaching for Multi-Target Domain Adaptationcited by 37
- 2020Unsupervised Monocular Depth Estimation for Night-time Images using Adversarial Domain Feature Adaptationcited by 35
- 2019GN-Net: The Gauss-Newton Loss for Multi-Weather Relocalizationcited by 32
- 2020Perception and Navigation in Autonomous Systems in the Era of Learning: A Surveycited by 30
- 2021Style-Aware Normalized Loss for Improving Arbitrary Style Transfercited by 30
- 2021Monocular Depth Estimation through Virtual-world Supervision and Real-world SfM Self-Supervisioncited by 24
- 2020Multi-task GANs for Semantic Segmentation and Depth Completion with Cycle Consistencycited by 18
- 2017Challenges in Monocular Visual Odometry: Photometric Calibration, Motion Bias and Rolling Shutter Effectcited by 12
- 2020When Autonomous Systems Meet Accuracy and Transferability through AI: A Surveycited by 7
- 2021Unsupervised Learning of Monocular Depth and Ego-Motion Using Multiple Maskscited by 6
- 2020Masked GANs for Unsupervised Depth and Pose Prediction with Scale Consistencycited by 3
Built on by
Citing papers per year: 2022: 4; 2023: 5; 2024: 12; 2025: 7.
28 papers.
Sort:
By area:
- 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
- 2023Robust Monocular Depth Estimation under Challenging Conditionscited by 58
- 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weathercited by 33
- 2023CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentationcited by 30
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditionscited by 29
- 2022UDepth: Fast Monocular Depth Estimation for Visually-guided Underwater Robotscited by 27
- 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priorscited by 20
- 2024Digging into contrastive learning for robust depth estimation with diffusion modelscited by 19
- 2023WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditionscited by 15
- 2025Depth Anything at Any Conditioncited by 11
- 2024The Third Monocular Depth Estimation Challengecited by 10
- 2025The Fourth Monocular Depth Estimation Challengecited by 8
16 more
- 2024Stealing Stable Diffusion Prior for Robust Monocular Depth Estimationcited by 6
- 2024Dusk Till Dawn: Self-supervised Nighttime Stereo Depth Estimation using Visual Foundation Modelscited by 6
- 2024Self-Supervised Monocular Depth Estimation in the Dark: Towards Data Distribution Compensationcited by 4
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Trainingcited by 4
- 2024Large Language Models Can Understanding Depth from Monocular Imagescited by 3
- 2023HDPV-SLAM: Hybrid Depth-augmented Panoramic Visual SLAM for Mobile Mapping System with Tilted LiDAR and Panoramic Visual Cameracited by 2
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimationcited by 2
- 2025Learning Depth from Past Selves: Self-Evolution Contrast for Robust Depth Estimationcited by 2
- 2024Robust Inverse Graphics via Probabilistic Inferencecited by 1
- 2024MetricDepth: Enhancing Monocular Depth Estimation with Deep Metric Learningcited by 1
- 2025PromptMono: Cross Prompting Attention for Self-Supervised Monocular Depth Estimation in Challenging Environmentscited by 1
- 2022RAZE: Region Guided Self-Supervised Gaze Representation Learningcited by 0
- 2022Towards Generalization on Real Domain for Single Image Dehazing via Meta-Learningcited by 0
- 2024KPNDepth: Depth Estimation of Lane Images under Complex Rainy Environmentcited by 0
- 2024PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environmentscited by 0
- 2025Deep Neural Networks for Accurate Depth Estimation with Latent Space Featurescited by 0
- 2025Learning Depth from Past Selves: Self-Evolution Contrast for Robust Depth Estimation19 Nov 2025
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimation31 Aug 2025
- 2025Depth Anything at Any Condition2 Jul 2025
- 2025The Fourth Monocular Depth Estimation Challenge24 Apr 2025
- 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priors26 Mar 2025
- 2025Deep Neural Networks for Accurate Depth Estimation with Latent Space Features17 Feb 2025
- 2025PromptMono: Cross Prompting Attention for Self-Supervised Monocular Depth Estimation in Challenging Environments23 Jan 2025
- 2024MetricDepth: Enhancing Monocular Depth Estimation with Deep Metric Learning29 Dec 2024
- 2024PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environments5 Dec 2024
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training4 Nov 2024
- 2024Large Language Models Can Understanding Depth from Monocular Images2 Sep 2024
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions23 Jul 2024
16 more
- 2024Dusk Till Dawn: Self-supervised Nighttime Stereo Depth Estimation using Visual Foundation Models18 May 2024
- 2024KPNDepth: Depth Estimation of Lane Images under Complex Rainy Environment16 May 2024
- 2024The Third Monocular Depth Estimation Challenge25 Apr 2024
- 2024Self-Supervised Monocular Depth Estimation in the Dark: Towards Data Distribution Compensation22 Apr 2024
- 2024Digging into contrastive learning for robust depth estimation with diffusion models15 Apr 2024
- 2024Stealing Stable Diffusion Prior for Robust Monocular Depth Estimation8 Mar 2024
- 2024Robust Inverse Graphics via Probabilistic Inference2 Feb 2024
- 2023WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditions9 Oct 2023
- 2023Robust Monocular Depth Estimation under Challenging Conditions18 Aug 2023
- 2023CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentation29 Jul 2023
- 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weather17 Jul 2023
- 2023HDPV-SLAM: Hybrid Depth-augmented Panoramic Visual SLAM for Mobile Mapping System with Tilted LiDAR and Panoramic Visual Camera27 Jan 2023
- 2022Towards Generalization on Real Domain for Single Image Dehazing via Meta-Learning14 Nov 2022
- 2022UDepth: Fast Monocular Depth Estimation for Visually-guided Underwater Robots26 Sep 2022
- 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformer6 Aug 2022
- 2022RAZE: Region Guided Self-Supervised Gaze Representation Learning4 Aug 2022
- 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
- 2023Robust Monocular Depth Estimation under Challenging Conditionscited by 58
- 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weathercited by 33
- 2023CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentationcited by 30
- 2022UDepth: Fast Monocular Depth Estimation for Visually-guided Underwater Robotscited by 27
- 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priorscited by 20
- 2023WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditionscited by 15
- 2025Depth Anything at Any Conditioncited by 11
- 2024The Third Monocular Depth Estimation Challengecited by 10
- 2025The Fourth Monocular Depth Estimation Challengecited by 8
- 2024Dusk Till Dawn: Self-supervised Nighttime Stereo Depth Estimation using Visual Foundation Modelscited by 6
- 2024Self-Supervised Monocular Depth Estimation in the Dark: Towards Data Distribution Compensationcited by 4
12 most cited of 25 All 25 (JSON)
- 2025Learning Depth from Past Selves: Self-Evolution Contrast for Robust Depth Estimation19 Nov 2025
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimation31 Aug 2025
- 2025Depth Anything at Any Condition2 Jul 2025
- 2025The Fourth Monocular Depth Estimation Challenge24 Apr 2025
- 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priors26 Mar 2025
- 2025Deep Neural Networks for Accurate Depth Estimation with Latent Space Features17 Feb 2025
- 2025PromptMono: Cross Prompting Attention for Self-Supervised Monocular Depth Estimation in Challenging Environments23 Jan 2025
- 2024MetricDepth: Enhancing Monocular Depth Estimation with Deep Metric Learning29 Dec 2024
- 2024PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environments5 Dec 2024
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training4 Nov 2024
- 2024Large Language Models Can Understanding Depth from Monocular Images2 Sep 2024
- 2024Dusk Till Dawn: Self-supervised Nighttime Stereo Depth Estimation using Visual Foundation Models18 May 2024
12 newest of 25 All 25 (JSON)