Frequency-Aware Self-Supervised Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
We present two versatile methods to generally enhance self-supervised monocular depth estimation (MDE) models. The high generalizability of our methods is achieved by solving the fundamental and ubiquitous problems in photometric loss function. In particular, from the perspective of spatial frequency, we first propose Ambiguity-Masking to suppress the incorrect supervision under photometric loss at specific object boundaries, the cause of which could be traced to pixel-level ambiguity. Second, we present a novel frequency-adaptive Gaussian low-pass filter, designed to robustify the photometric loss in high-frequency regions. We are the first to propose blurring images to improve depth estimators with an interpretable analysis. Both modules are lightweight, adding no parameters and no need to manually change the network structures. Experiments show that our methods provide performance boosts to a large number of existing models, including those who claimed state-of-the-art, while introducing no extra inference computation at all.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 11 Oct 2022.
Builds on
28 of 40 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 455
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
16 more
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
- 2020Consistent Video Depth Estimationcited by 220
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
- 2019Self-Supervised Monocular Depth Hintscited by 127
- 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
- 2019Depth Completion from Sparse LiDAR Data with Depth-Normal Constraintscited by 108
- 2018Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understandingcited by 101
- 2018Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometrycited by 85
- 2020The Edge of Depth: Explicit Constraints between Segmentation and Depthcited by 72
- 2021Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimationcited by 63
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
- 2020Forget About the LiDAR: Self-Supervised Depth Estimators with MED Probability Volumescited by 50
- 2021Single Image Depth Prediction with Wavelet Decompositioncited by 34
- 2019Video Object Segmentation-based Visual Servo Control and Object Depth Estimation on a Mobile Robotcited by 14
Built on by
Citing papers per year: 2023: 2; 2024: 1.
3 papers.
- 2023Camera Height Doesn't Change: Unsupervised Training for Metric Monocular Road-Scene Depth Estimationcited by 3
- 2024FlowDepth: Decoupling Optical Flow for Self-Supervised Monocular Depth Estimationcited by 2
- 2023Do More With What You Have: Transferring Depth-Scale from Labeled to Unlabeled Domainscited by 1
- 2024FlowDepth: Decoupling Optical Flow for Self-Supervised Monocular Depth Estimation28 Mar 2024
- 2023Camera Height Doesn't Change: Unsupervised Training for Metric Monocular Road-Scene Depth Estimation7 Dec 2023
- 2023Do More With What You Have: Transferring Depth-Scale from Labeled to Unlabeled Domains14 Mar 2023