mlsanityData to 7 Oct 2026

Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimation

arXiv 2209.07088 ↗First posted 15 Sep 2022cs.CVcited by 17

Not on the map. Why?

Abstract (arXiv)

Self-supervised monocular depth estimation has received much attention recently in computer vision. Most of the existing works in literature aggregate multi-scale features for depth prediction via either straightforward concatenation or element-wise addition, however, such feature aggregation operations generally neglect the contextual consistency between multi-scale features. Addressing this problem, we propose the Self-Distilled Feature Aggregation (SDFA) module for simultaneously aggregating a pair of low-scale and high-scale features and maintaining their contextual consistency. The SDFA employs three branches to learn three feature offset maps respectively: one offset map for refining the input low-scale feature and the other two for refining the input high-scale feature under a designed self-distillation manner. Then, we propose an SDFA-based network for self-supervised monocular depth estimation, and design a self-distilled training strategy to train the proposed network with the SDFA module. Experimental results on the KITTI dataset demonstrate that the proposed method outperforms the comparative state-of-the-art methods in most cases. The code is available at https://github.com/ZM-Zhou/SDFA-Net_pytorch.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 50 of its 60 references that are in the map. First posted on arXiv 15 Sep 2022.

Builds on

50 of 60 references.

References · 50

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  8. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  9. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  10. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  11. 2021Vision Transformers for Dense Predictioncited by 1,789
  12. 2020Knowledge Distillation: A Surveycited by 1,578
38 more
  1. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  2. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
  3. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  4. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  5. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
  6. 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
  7. 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
  8. 2017Sparsity Invariant CNNscited by 325
  9. 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
  10. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  11. 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
  12. 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
  13. 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
  14. 2019Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Cameracited by 130
  15. 2020Semantic Flow for Fast and Accurate Scene Parsingcited by 128
  16. 2019Self-Supervised Monocular Depth Hintscited by 127
  17. 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
  18. 2020Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volumecited by 116
  19. 2020Improving Semantic Segmentation via Decoupled Body and Edge Supervisioncited by 98
  20. 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
  21. 2020The Edge of Depth: Explicit Constraints between Segmentation and Depthcited by 72
  22. 2018Learning Monocular Depth by Distilling Cross-domain Stereo Networkscited by 64
  23. 2019Learning monocular depth estimation infusing traditional stereo knowledgecited by 64
  24. 2021Regularizing Nighttime Weirdness: Efficient Self-supervised Monocular Depth Estimation in the Darkcited by 57
  25. 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
  26. 2020AlignSeg: Feature-Aligned Segmentation Networkscited by 53
  27. 2020Forget About the LiDAR: Self-Supervised Depth Estimators with MED Probability Volumescited by 50
  28. 2019Refine and Distill: Exploiting Cycle-Inconsistency and Knowledge Distillation for Unsupervised Monocular Depth Estimationcited by 48
  29. 2021Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimationcited by 48
  30. 2021Self-supervised Monocular Depth Estimation for All Day Images using Domain Separationcited by 44
  31. 2021MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 38
  32. 2021Single Image Depth Prediction with Wavelet Decompositioncited by 34
  33. 2019Moving Indoor: Unsupervised Video Depth Learning in Challenging Environmentscited by 31
  34. 2021PLADE-Net: Towards Pixel-Level Accuracy for Self-Supervised Single-View Depth Estimation with Neural Positional Encoding and Distilled Matting Losscited by 31
  35. 2020Adaptive confidence thresholding for monocular depth estimationcited by 25
  36. 2020EffiScene: Efficient Per-Pixel Rigidity Inference for Unsupervised Joint Learning of Optical Flow, Depth, Camera Pose and Motion Segmentationcited by 22
  37. 2020S3Net: Semantic-Aware Self-supervised Depth Estimation with Monocular Videos and Synthetic Datacited by 12
  38. 2021Shallow Features Guide Unsupervised Domain Adaptation for Semantic Segmentation at Class Boundariescited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 6; 2024: 5; 2025: 1; 2026: 1.

17 papers.

Sort:

By area:

  1. 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
  2. 2024Playing to Vision Foundation Model's Strengths in Stereo Matchingcited by 23
  3. 2023Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Networkcited by 14
  4. 2023From-Ground-To-Objects: Coarse-to-Fine Self-supervised Monocular Depth Estimation of Dynamic Objects with Ground Contact Priorcited by 13
  5. 2022SfM-TTR: Using Structure from Motion for Test-Time Refinement of Single-View Depth Networkscited by 10
  6. 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimationcited by 8
  7. 2023EMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigiditycited by 4
  8. 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Trainingcited by 4
  9. 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimationcited by 3
  10. 2024High-Precision Self-Supervised Monocular Depth Estimation with Rich-Resource Priorcited by 2
  11. 2023HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decodercited by 1
  12. 2022Heterogeneous Feature Distillation Network for SAR Image Semantic Segmentationcited by 0
5 more
  1. 2022Spatial-Temporal Attention Network for Open-Set Fine-Grained Image Recognitioncited by 0
  2. 2023Exploring the Mutual Influence between Self-Supervised Single-Frame and Multi-Frame Depth Estimationcited by 0
  3. 2024Mask-adaptive Gated Convolution and Bi-directional Progressive Fusion Network for Depth Completioncited by 0
  4. 2024FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimationcited by 0
  5. 2026RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flowcited by 0