Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Self-supervised methods play an increasingly important role in monocular depth estimation due to their great potential and low annotation cost. To close the gap with supervised methods, recent works take advantage of extra constraints, e.g., semantic segmentation. However, these methods will inevitably increase the burden on the model. In this paper, we show theoretical and empirical evidence that the potential capacity of self-supervised monocular depth estimation can be excavated without increasing this cost. In particular, we propose (1) a novel data augmentation approach called data grafting, which forces the model to explore more cues to infer depth besides the vertical image position, (2) an exploratory self-distillation loss, which is supervised by the self-distillation label generated by our new post-processing method - selective post-processing, and (3) the full-scale network, designed to endow the encoder with the specialization of depth estimation task and enhance the representational power of the model. Extensive experiments show that our contributions can bring significant performance improvement to the baseline with even less computational overhead, and our model, named EPCDepth, surpasses the previous state-of-the-art methods even those supervised by additional constraints.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 51 of its 67 references that are in the map. First posted on arXiv 26 Sep 2021.
Builds on
51 of 67 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2014Going Deeper with Convolutionscited by 4,231
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
38 more
- 2017Random Erasing Data Augmentationcited by 1,235
- 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
- 2019Relational Knowledge Distillationcited by 873
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2018Born Again Neural Networkscited by 539
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2019A Comprehensive Overhaul of Feature Distillationcited by 341
- 2019Correlation Congruence for Knowledge Distillationcited by 280
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
- 2019Learning Lightweight Lane Detection CNNs by Self Attention Distillationcited by 162
- 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
- 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
- 2020Regularizing Class-wise Predictions via Self-knowledge Distillationcited by 144
- 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
- 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
- 2019Self-Supervised Monocular Depth Hintscited by 127
- 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
- 2017Semi-Supervised Deep Learning for Monocular Depth Map Predictioncited by 109
- 2018Snapshot Distillation: Teacher-Student Optimization in One Generationcited by 99
- 2018Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometrycited by 85
- 2019How do neural networks see depth in single images?cited by 82
- 2020The Edge of Depth: Explicit Constraints between Segmentation and Depthcited by 72
- 2018SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimationcited by 64
- 2017A Bayesian Data Augmentation Approach for Learning Deep Modelscited by 50
- 2019Refine and Distill: Exploiting Cycle-Inconsistency and Knowledge Distillation for Unsupervised Monocular Depth Estimationcited by 48
- 2019Bilateral Cyclic Constraint and Adaptive Regularization for Unsupervised Monocular Depth Predictioncited by 44
- 2019Pyramid Multi-view Stereo Net with Self-adaptive View Aggregationcited by 44
- 2020P2Net: Patch-match and Plane-regularization for Unsupervised Indoor Depth Estimationcited by 41
- 2018Single View Stereo Matchingcited by 39
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 9; 2023: 14; 2024: 17; 2025: 5; 2026: 2.
48 papers.
Sort:
By area:
- 2022RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimationcited by 36
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
- 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weathercited by 33
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditionscited by 29
- 2022DevNet: Self-supervised Monocular Depth Learning via Density Volume Constructioncited by 22
- 2023SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimationcited by 21
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
- 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimationcited by 20
- 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priorscited by 20
- 2022Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimationcited by 17
- 2023Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attackscited by 17
36 more
- 2023WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditionscited by 15
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Surveycited by 15
- 2023GasMono: Geometry-Aided Self-Supervised Monocular Depth Estimation for Indoor Scenescited by 13
- 2023MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Modelcited by 12
- 2024DCPI-Depth: Explicitly Infusing Dense Correspondence Prior to Unsupervised Monocular Depth Estimationcited by 12
- 2024The Third Monocular Depth Estimation Challengecited by 10
- 2024Mono-ViFI: A Unified Learning Framework for Self-supervised Single- and Multi-frame Monocular Depth Estimationcited by 9
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokenscited by 9
- 2021THE Benchmark: Transferable Representation Learning for Monocular Height Estimationcited by 8
- 2022Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Drivingcited by 8
- 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimationcited by 8
- 2024SPIdepth: Strengthened Pose Information for Self-supervised Monocular Depth Estimationcited by 8
- 2025The Fourth Monocular Depth Estimation Challengecited by 8
- 2022RAFT-MSF: Self-Supervised Monocular Scene Flow using Recurrent Optimizercited by 7
- 2024Towards Cross-View-Consistent Self-Supervised Surround Depth Estimationcited by 7
- 2023MonoProb: Self-Supervised Monocular Depth Estimation with Interpretable Uncertaintycited by 6
- 2024Dusk Till Dawn: Self-supervised Nighttime Stereo Depth Estimation using Visual Foundation Modelscited by 6
- 2024Self-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attackscited by 5
- 2023Towards Better Data Exploitation in Self-Supervised Monocular Depth Estimationcited by 4
- 2023EC-Depth: Exploring the consistency of self-supervised monocular depth estimation in challenging scenescited by 4
- 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimationcited by 4
- 2024Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstructioncited by 4
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Trainingcited by 4
- 2023GenDepth: Generalizing Monocular Depth Estimation for Arbitrary Camera Parameters via Ground Plane Embeddingcited by 2
- 2024GVDepth: Zero-Shot Monocular Depth Estimation for Ground Vehicles based on Probabilistic Cue Fusioncited by 2
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimationcited by 2
- 2023SemHint-MD: Learning from Noisy Semantic Labels for Self-Supervised Monocular Depth Estimationcited by 1
- 2022N-QGN: Navigation Map from a Monocular Camera using Quadtree Generating Networkscited by 0
- 2022Detaching and Boosting: Dual Engine for Scale-Invariant Self-Supervised Monocular Depth Estimationcited by 0
- 2022SelfOdom: Self-supervised Egomotion and Depth Learning via Bi-directional Coarse-to-Fine Scale Recoverycited by 0
- 2023FG-Depth: Flow-Guided Unsupervised Monocular Depth Estimationcited by 0
- 2023SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detectioncited by 0
- 2024Multiple Prior Representation Learning for Self-Supervised Monocular Depth Estimation via Hybrid Transformercited by 0
- 2024PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environmentscited by 0
- 2026Adaptive Depth-converted-Scale Convolution for Self-supervised Monocular Depth Estimationcited by 0
- 2026CDPR: Cross-modal Diffusion with Polarization for Reliable Monocular Depth Estimationcited by 0
- 2026CDPR: Cross-modal Diffusion with Polarization for Reliable Monocular Depth Estimation13 Apr 2026
- 2026Adaptive Depth-converted-Scale Convolution for Self-supervised Monocular Depth Estimation9 Apr 2026
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimation31 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025The Fourth Monocular Depth Estimation Challenge24 Apr 2025
- 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priors26 Mar 2025
- 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimation20 Mar 2025
- 2024GVDepth: Zero-Shot Monocular Depth Estimation for Ground Vehicles based on Probabilistic Cue Fusion8 Dec 2024
- 2024PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environments5 Dec 2024
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training4 Nov 2024
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions3 Oct 2024
- 2024Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstruction5 Sep 2024
36 more
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions23 Jul 2024
- 2024Mono-ViFI: A Unified Learning Framework for Self-supervised Single- and Multi-frame Monocular Depth Estimation19 Jul 2024
- 2024Towards Cross-View-Consistent Self-Supervised Surround Depth Estimation4 Jul 2024
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Survey28 Jun 2024
- 2024Multiple Prior Representation Learning for Self-Supervised Monocular Depth Estimation via Hybrid Transformer13 Jun 2024
- 2024Self-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attacks9 Jun 2024
- 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation6 Jun 2024
- 2024DCPI-Depth: Explicitly Infusing Dense Correspondence Prior to Unsupervised Monocular Depth Estimation27 May 2024
- 2024Dusk Till Dawn: Self-supervised Nighttime Stereo Depth Estimation using Visual Foundation Models18 May 2024
- 2024The Third Monocular Depth Estimation Challenge25 Apr 2024
- 2024SPIdepth: Strengthened Pose Information for Self-supervised Monocular Depth Estimation18 Apr 2024
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimation4 Apr 2024
- 2023GenDepth: Generalizing Monocular Depth Estimation for Arbitrary Camera Parameters via Ground Plane Embedding10 Dec 2023
- 2023MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Model13 Nov 2023
- 2023MonoProb: Self-Supervised Monocular Depth Estimation with Interpretable Uncertainty10 Nov 2023
- 2023EC-Depth: Exploring the consistency of self-supervised monocular depth estimation in challenging scenes12 Oct 2023
- 2023WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditions9 Oct 2023
- 2023GasMono: Geometry-Aided Self-Supervised Monocular Depth Estimation for Indoor Scenes26 Sep 2023
- 2023Towards Better Data Exploitation in Self-Supervised Monocular Depth Estimation11 Sep 2023
- 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimation2 Sep 2023
- 2023SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimation1 Sep 2023
- 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weather17 Jul 2023
- 2023SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detection5 Jul 2023
- 2023SemHint-MD: Learning from Noisy Semantic Labels for Self-Supervised Monocular Depth Estimation31 Mar 2023
- 2023Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attacks31 Jan 2023
- 2023FG-Depth: Flow-Guided Unsupervised Monocular Depth Estimation20 Jan 2023
- 2022SelfOdom: Self-supervised Egomotion and Depth Learning via Bi-directional Coarse-to-Fine Scale Recovery16 Nov 2022
- 2022Detaching and Boosting: Dual Engine for Scale-Invariant Self-Supervised Monocular Depth Estimation8 Oct 2022
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planes4 Oct 2022
- 2022Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimation15 Sep 2022
- 2022DevNet: Self-supervised Monocular Depth Learning via Density Volume Construction14 Sep 2022
- 2022RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimation25 Jul 2022
- 2022Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Driving18 May 2022
- 2022RAFT-MSF: Self-Supervised Monocular Scene Flow using Recurrent Optimizer3 May 2022
- 2022N-QGN: Navigation Map from a Monocular Camera using Quadtree Generating Networks24 Feb 2022
- 2021THE Benchmark: Transferable Representation Learning for Monocular Height Estimation30 Dec 2021
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditionscited by 29
- 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimationcited by 20
- 2023MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Modelcited by 12
- 2023SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detectioncited by 0
- 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimation20 Mar 2025
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions23 Jul 2024
- 2023MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Model13 Nov 2023
- 2023SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detection5 Jul 2023
- 2022RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimationcited by 36
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
- 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weathercited by 33
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
- 2022DevNet: Self-supervised Monocular Depth Learning via Density Volume Constructioncited by 22
- 2023SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimationcited by 21
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
- 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priorscited by 20
- 2022Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimationcited by 17
- 2023Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attackscited by 17
- 2023WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditionscited by 15
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Surveycited by 15
12 most cited of 43 All 43 (JSON)
- 2026CDPR: Cross-modal Diffusion with Polarization for Reliable Monocular Depth Estimation13 Apr 2026
- 2026Adaptive Depth-converted-Scale Convolution for Self-supervised Monocular Depth Estimation9 Apr 2026
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimation31 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025The Fourth Monocular Depth Estimation Challenge24 Apr 2025
- 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priors26 Mar 2025
- 2024GVDepth: Zero-Shot Monocular Depth Estimation for Ground Vehicles based on Probabilistic Cue Fusion8 Dec 2024
- 2024PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environments5 Dec 2024
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training4 Nov 2024
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions3 Oct 2024
- 2024Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstruction5 Sep 2024
- 2024Mono-ViFI: A Unified Learning Framework for Self-supervised Single- and Multi-frame Monocular Depth Estimation19 Jul 2024
12 newest of 43 All 43 (JSON)