Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Self-supervised monocular depth estimation has received much attention recently in computer vision. Most of the existing works in literature aggregate multi-scale features for depth prediction via either straightforward concatenation or element-wise addition, however, such feature aggregation operations generally neglect the contextual consistency between multi-scale features. Addressing this problem, we propose the Self-Distilled Feature Aggregation (SDFA) module for simultaneously aggregating a pair of low-scale and high-scale features and maintaining their contextual consistency. The SDFA employs three branches to learn three feature offset maps respectively: one offset map for refining the input low-scale feature and the other two for refining the input high-scale feature under a designed self-distillation manner. Then, we propose an SDFA-based network for self-supervised monocular depth estimation, and design a self-distilled training strategy to train the proposed network with the SDFA module. Experimental results on the KITTI dataset demonstrate that the proposed method outperforms the comparative state-of-the-art methods in most cases. The code is available at https://github.com/ZM-Zhou/SDFA-Net_pytorch.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 50 of its 60 references that are in the map. First posted on arXiv 15 Sep 2022.
Builds on
50 of 60 references.
References · 50
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2020Knowledge Distillation: A Surveycited by 1,578
38 more
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2017Sparsity Invariant CNNscited by 325
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
- 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
- 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
- 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
- 2019Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Cameracited by 130
- 2020Semantic Flow for Fast and Accurate Scene Parsingcited by 128
- 2019Self-Supervised Monocular Depth Hintscited by 127
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2020Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volumecited by 116
- 2020Improving Semantic Segmentation via Decoupled Body and Edge Supervisioncited by 98
- 2021FaPN: Feature-aligned Pyramid Network for Dense Image Predictioncited by 81
- 2020The Edge of Depth: Explicit Constraints between Segmentation and Depthcited by 72
- 2018Learning Monocular Depth by Distilling Cross-domain Stereo Networkscited by 64
- 2019Learning monocular depth estimation infusing traditional stereo knowledgecited by 64
- 2021Regularizing Nighttime Weirdness: Efficient Self-supervised Monocular Depth Estimation in the Darkcited by 57
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
- 2020AlignSeg: Feature-Aligned Segmentation Networkscited by 53
- 2020Forget About the LiDAR: Self-Supervised Depth Estimators with MED Probability Volumescited by 50
- 2019Refine and Distill: Exploiting Cycle-Inconsistency and Knowledge Distillation for Unsupervised Monocular Depth Estimationcited by 48
- 2021Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimationcited by 48
- 2021Self-supervised Monocular Depth Estimation for All Day Images using Domain Separationcited by 44
- 2021MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 38
- 2021Single Image Depth Prediction with Wavelet Decompositioncited by 34
- 2019Moving Indoor: Unsupervised Video Depth Learning in Challenging Environmentscited by 31
- 2021PLADE-Net: Towards Pixel-Level Accuracy for Self-Supervised Single-View Depth Estimation with Neural Positional Encoding and Distilled Matting Losscited by 31
- 2020Adaptive confidence thresholding for monocular depth estimationcited by 25
- 2020EffiScene: Efficient Per-Pixel Rigidity Inference for Unsupervised Joint Learning of Optical Flow, Depth, Camera Pose and Motion Segmentationcited by 22
- 2020S3Net: Semantic-Aware Self-supervised Depth Estimation with Monocular Videos and Synthetic Datacited by 12
- 2021Shallow Features Guide Unsupervised Domain Adaptation for Semantic Segmentation at Class Boundariescited by 10
Built on by
Citing papers per year: 2022: 4; 2023: 6; 2024: 5; 2025: 1; 2026: 1.
17 papers.
Sort:
By area:
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
- 2024Playing to Vision Foundation Model's Strengths in Stereo Matchingcited by 23
- 2023Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Networkcited by 14
- 2023From-Ground-To-Objects: Coarse-to-Fine Self-supervised Monocular Depth Estimation of Dynamic Objects with Ground Contact Priorcited by 13
- 2022SfM-TTR: Using Structure from Motion for Test-Time Refinement of Single-View Depth Networkscited by 10
- 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimationcited by 8
- 2023EMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigiditycited by 4
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Trainingcited by 4
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimationcited by 3
- 2024High-Precision Self-Supervised Monocular Depth Estimation with Rich-Resource Priorcited by 2
- 2023HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decodercited by 1
- 2022Heterogeneous Feature Distillation Network for SAR Image Semantic Segmentationcited by 0
5 more
- 2022Spatial-Temporal Attention Network for Open-Set Fine-Grained Image Recognitioncited by 0
- 2023Exploring the Mutual Influence between Self-Supervised Single-Frame and Multi-Frame Depth Estimationcited by 0
- 2024Mask-adaptive Gated Convolution and Bi-directional Progressive Fusion Network for Depth Completioncited by 0
- 2024FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimationcited by 0
- 2026RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flowcited by 0
- 2026RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flow21 Apr 2026
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimation18 Aug 2025
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training4 Nov 2024
- 2024High-Precision Self-Supervised Monocular Depth Estimation with Rich-Resource Prior1 Aug 2024
- 2024FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimation17 May 2024
- 2024Playing to Vision Foundation Model's Strengths in Stereo Matching9 Apr 2024
- 2024Mask-adaptive Gated Convolution and Bi-directional Progressive Fusion Network for Depth Completion15 Jan 2024
- 2023From-Ground-To-Objects: Coarse-to-Fine Self-supervised Monocular Depth Estimation of Dynamic Objects with Ground Contact Prior15 Dec 2023
- 2023EMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigidity4 Sep 2023
- 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimation2 Sep 2023
- 2023Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Network10 Aug 2023
- 2023HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decoder30 May 2023
5 more
- 2023Exploring the Mutual Influence between Self-Supervised Single-Frame and Multi-Frame Depth Estimation25 Apr 2023
- 2022Spatial-Temporal Attention Network for Open-Set Fine-Grained Image Recognition25 Nov 2022
- 2022SfM-TTR: Using Structure from Motion for Test-Time Refinement of Single-View Depth Networks24 Nov 2022
- 2022Heterogeneous Feature Distillation Network for SAR Image Semantic Segmentation17 Oct 2022
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planes4 Oct 2022
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
- 2024Playing to Vision Foundation Model's Strengths in Stereo Matchingcited by 23
- 2023Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Networkcited by 14
- 2023From-Ground-To-Objects: Coarse-to-Fine Self-supervised Monocular Depth Estimation of Dynamic Objects with Ground Contact Priorcited by 13
- 2022SfM-TTR: Using Structure from Motion for Test-Time Refinement of Single-View Depth Networkscited by 10
- 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimationcited by 8
- 2023EMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigiditycited by 4
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Trainingcited by 4
- 2024High-Precision Self-Supervised Monocular Depth Estimation with Rich-Resource Priorcited by 2
- 2023HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decodercited by 1
- 2022Heterogeneous Feature Distillation Network for SAR Image Semantic Segmentationcited by 0
- 2022Spatial-Temporal Attention Network for Open-Set Fine-Grained Image Recognitioncited by 0
12 most cited of 16 All 16 (JSON)
- 2026RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flow21 Apr 2026
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training4 Nov 2024
- 2024High-Precision Self-Supervised Monocular Depth Estimation with Rich-Resource Prior1 Aug 2024
- 2024FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimation17 May 2024
- 2024Playing to Vision Foundation Model's Strengths in Stereo Matching9 Apr 2024
- 2024Mask-adaptive Gated Convolution and Bi-directional Progressive Fusion Network for Depth Completion15 Jan 2024
- 2023From-Ground-To-Objects: Coarse-to-Fine Self-supervised Monocular Depth Estimation of Dynamic Objects with Ground Contact Prior15 Dec 2023
- 2023EMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigidity4 Sep 2023
- 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimation2 Sep 2023
- 2023Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Network10 Aug 2023
- 2023HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decoder30 May 2023
- 2023Exploring the Mutual Influence between Self-Supervised Single-Frame and Multi-Frame Depth Estimation25 Apr 2023
12 newest of 16 All 16 (JSON)