mlsanityData to 7 Oct 2026

Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimation

arXiv 2109.12484 ↗First posted 26 Sep 2021cs.CV cs.AIcited by 48

Not on the map. Why?

Abstract (arXiv)

Self-supervised methods play an increasingly important role in monocular depth estimation due to their great potential and low annotation cost. To close the gap with supervised methods, recent works take advantage of extra constraints, e.g., semantic segmentation. However, these methods will inevitably increase the burden on the model. In this paper, we show theoretical and empirical evidence that the potential capacity of self-supervised monocular depth estimation can be excavated without increasing this cost. In particular, we propose (1) a novel data augmentation approach called data grafting, which forces the model to explore more cues to infer depth besides the vertical image position, (2) an exploratory self-distillation loss, which is supervised by the self-distillation label generated by our new post-processing method - selective post-processing, and (3) the full-scale network, designed to endow the encoder with the specialization of depth estimation task and enhance the representational power of the model. Extensive experiments show that our contributions can bring significant performance improvement to the baseline with even less computational overhead, and our model, named EPCDepth, surpasses the previous state-of-the-art methods even those supervised by additional constraints.

Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 51 of its 67 references that are in the map. First posted on arXiv 26 Sep 2021.

Builds on

51 of 67 references.

References · 51

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  7. 2014Going Deeper with Convolutionscited by 4,231
  8. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  9. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
  10. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  12. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
38 more
  1. 2017Random Erasing Data Augmentationcited by 1,235
  2. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  3. 2019Relational Knowledge Distillationcited by 873
  4. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  5. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  6. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  7. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
  8. 2018Born Again Neural Networkscited by 539
  9. 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
  10. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  11. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
  12. 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
  13. 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
  14. 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
  15. 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
  16. 2019A Comprehensive Overhaul of Feature Distillationcited by 341
  17. 2019Correlation Congruence for Knowledge Distillationcited by 280
  18. 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
  19. 2019Learning Lightweight Lane Detection CNNs by Self Attention Distillationcited by 162
  20. 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
  21. 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
  22. 2020Regularizing Class-wise Predictions via Self-knowledge Distillationcited by 144
  23. 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
  24. 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
  25. 2019Self-Supervised Monocular Depth Hintscited by 127
  26. 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
  27. 2017Semi-Supervised Deep Learning for Monocular Depth Map Predictioncited by 109
  28. 2018Snapshot Distillation: Teacher-Student Optimization in One Generationcited by 99
  29. 2018Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometrycited by 85
  30. 2019How do neural networks see depth in single images?cited by 82
  31. 2020The Edge of Depth: Explicit Constraints between Segmentation and Depthcited by 72
  32. 2018SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimationcited by 64
  33. 2017A Bayesian Data Augmentation Approach for Learning Deep Modelscited by 50
  34. 2019Refine and Distill: Exploiting Cycle-Inconsistency and Knowledge Distillation for Unsupervised Monocular Depth Estimationcited by 48
  35. 2019Bilateral Cyclic Constraint and Adaptive Regularization for Unsupervised Monocular Depth Predictioncited by 44
  36. 2019Pyramid Multi-view Stereo Net with Self-adaptive View Aggregationcited by 44
  37. 2020P2Net: Patch-match and Plane-regularization for Unsupervised Indoor Depth Estimationcited by 41
  38. 2018Single View Stereo Matchingcited by 39

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 9; 2023: 14; 2024: 17; 2025: 5; 2026: 2.

48 papers.

Sort:

By area:

  1. 2022RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimationcited by 36
  2. 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
  3. 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weathercited by 33
  4. 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
  5. 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditionscited by 29
  6. 2022DevNet: Self-supervised Monocular Depth Learning via Density Volume Constructioncited by 22
  7. 2023SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimationcited by 21
  8. 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 20
  9. 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimationcited by 20
  10. 2025Synthetic-to-Real Self-supervised Robust Depth Estimation via Learning with Motion and Structure Priorscited by 20
  11. 2022Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimationcited by 17
  12. 2023Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attackscited by 17
36 more
  1. 2023WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditionscited by 15
  2. 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Surveycited by 15
  3. 2023GasMono: Geometry-Aided Self-Supervised Monocular Depth Estimation for Indoor Scenescited by 13
  4. 2023MonoDiffusion: Self-Supervised Monocular Depth Estimation Using Diffusion Modelcited by 12
  5. 2024DCPI-Depth: Explicitly Infusing Dense Correspondence Prior to Unsupervised Monocular Depth Estimationcited by 12
  6. 2024The Third Monocular Depth Estimation Challengecited by 10
  7. 2024Mono-ViFI: A Unified Learning Framework for Self-supervised Single- and Multi-frame Monocular Depth Estimationcited by 9
  8. 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokenscited by 9
  9. 2021THE Benchmark: Transferable Representation Learning for Monocular Height Estimationcited by 8
  10. 2022Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Drivingcited by 8
  11. 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimationcited by 8
  12. 2024SPIdepth: Strengthened Pose Information for Self-supervised Monocular Depth Estimationcited by 8
  13. 2025The Fourth Monocular Depth Estimation Challengecited by 8
  14. 2022RAFT-MSF: Self-Supervised Monocular Scene Flow using Recurrent Optimizercited by 7
  15. 2024Towards Cross-View-Consistent Self-Supervised Surround Depth Estimationcited by 7
  16. 2023MonoProb: Self-Supervised Monocular Depth Estimation with Interpretable Uncertaintycited by 6
  17. 2024Dusk Till Dawn: Self-supervised Nighttime Stereo Depth Estimation using Visual Foundation Modelscited by 6
  18. 2024Self-supervised Adversarial Training of Monocular Depth Estimation against Physical-World Attackscited by 5
  19. 2023Towards Better Data Exploitation in Self-Supervised Monocular Depth Estimationcited by 4
  20. 2023EC-Depth: Exploring the consistency of self-supervised monocular depth estimation in challenging scenescited by 4
  21. 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimationcited by 4
  22. 2024Surface-Centric Modeling for High-Fidelity Generalizable Neural Surface Reconstructioncited by 4
  23. 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Trainingcited by 4
  24. 2023GenDepth: Generalizing Monocular Depth Estimation for Arbitrary Camera Parameters via Ground Plane Embeddingcited by 2
  25. 2024GVDepth: Zero-Shot Monocular Depth Estimation for Ground Vehicles based on Probabilistic Cue Fusioncited by 2
  26. 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimationcited by 2
  27. 2023SemHint-MD: Learning from Noisy Semantic Labels for Self-Supervised Monocular Depth Estimationcited by 1
  28. 2022N-QGN: Navigation Map from a Monocular Camera using Quadtree Generating Networkscited by 0
  29. 2022Detaching and Boosting: Dual Engine for Scale-Invariant Self-Supervised Monocular Depth Estimationcited by 0
  30. 2022SelfOdom: Self-supervised Egomotion and Depth Learning via Bi-directional Coarse-to-Fine Scale Recoverycited by 0
  31. 2023FG-Depth: Flow-Guided Unsupervised Monocular Depth Estimationcited by 0
  32. 2023SVDM: Single-View Diffusion Model for Pseudo-Stereo 3D Object Detectioncited by 0
  33. 2024Multiple Prior Representation Learning for Self-Supervised Monocular Depth Estimation via Hybrid Transformercited by 0
  34. 2024PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environmentscited by 0
  35. 2026Adaptive Depth-converted-Scale Convolution for Self-supervised Monocular Depth Estimationcited by 0
  36. 2026CDPR: Cross-modal Diffusion with Polarization for Reliable Monocular Depth Estimationcited by 0