Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Although existing monocular depth estimation methods have made great progress, predicting an accurate absolute depth map from a single image is still challenging due to the limited modeling capacity of networks and the scale ambiguity issue. In this paper, we introduce a fully Visual Attention-based Depth (VADepth) network, where spatial attention and channel attention are applied to all stages. By continuously extracting the dependencies of features along the spatial and channel dimensions over a long distance, VADepth network can effectively preserve important details and suppress interfering features to better perceive the scene structure for more accurate depth estimates. In addition, we utilize geometric priors to form scale constraints for scale-aware model training. Specifically, we construct a novel scale-aware loss using the distance between the camera and a plane fitted by the ground points corresponding to the pixels of the rectangular area in the bottom middle of the image. Experimental results on the KITTI dataset show that this architecture achieves the state-of-the-art performance and our method can directly output absolute depth without post-processing. Moreover, our experiments on the SeasonDepth dataset also demonstrate the robustness of our model to multiple unseen environments.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 39 of its 50 references that are in the map. First posted on arXiv 18 May 2022.
Builds on
39 of 50 references.
References · 39
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2015Spatial Transformer Networkscited by 1,423
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2018Dual Attention Network for Scene Segmentationcited by 1,001
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
27 more
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2014Recurrent Models of Visual Attentioncited by 344
- 2017Sparsity Invariant CNNscited by 325
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 248
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2022Visual Attention Networkcited by 210
- 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
- 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
- 2020Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volumecited by 116
- 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
- 2016Deep3D: Fully Automatic 2D-to-3D Video Conversion with Deep Convolutional Neural Networkscited by 72
- 2021Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimationcited by 63
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
- 2021Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimationcited by 48
- 2018LEGO: Learning Edge with Geometry all at Once by Watching Videoscited by 47
- 2020Toward Hierarchical Self-Supervised Monocular Absolute Depth Estimation for Autonomous Driving Applicationscited by 40
- 2020Self-Supervised Scale Recovery for Monocular Depth and Egomotion Estimationcited by 21
- 2019Attention-based Context Aggregation Network for Monocular Depth Estimationcited by 18
- 2017J-MOD2: Joint Monocular Obstacle Detection and Depth Estimationcited by 9
- 2020SeasonDepth: Cross-Season Monocular Depth Prediction Dataset and Benchmark under Multiple Environmentscited by 9
- 2021EdgeConv with Attention Module for Monocular Depth Estimationcited by 9
- 2021LiDARTouch: Monocular metric depth estimation with a few-beam LiDARcited by 7
- 2017Probabilistic Global Scale Estimation for MonoSLAM Based on Generic Object Detectioncited by 2
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 2; 2026: 1.
8 papers.
- 2024GroCo: Ground Constraint for Metric Self-Supervised Monocular Depthcited by 6
- 2024MonoPP: Metric-Scaled Self-Supervised Monocular Depth Estimation by Planar-Parallax Geometry in Automotive Applicationscited by 4
- 2023Camera Height Doesn't Change: Unsupervised Training for Metric Monocular Road-Scene Depth Estimationcited by 3
- 2025A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimationcited by 2
- 2025Gamma-from-Mono: Road-Relative, Metric, Self-Supervised Monocular Geometry for Vehicular Applicationscited by 1
- 2023Pose Constraints for Consistent Self-supervised Monocular Depth and Ego-motioncited by 0
- 2023Exploring the Mutual Influence between Self-Supervised Single-Frame and Multi-Frame Depth Estimationcited by 0
- 2026SA4Depth: Consistent Pose-Depth Scale Alignment for Self-Supervised Monocular Depth Estimationcited by 0
- 2026SA4Depth: Consistent Pose-Depth Scale Alignment for Self-Supervised Monocular Depth Estimation27 May 2026
- 2025Gamma-from-Mono: Road-Relative, Metric, Self-Supervised Monocular Geometry for Vehicular Applications3 Dec 2025
- 2025A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation14 Jan 2025
- 2024MonoPP: Metric-Scaled Self-Supervised Monocular Depth Estimation by Planar-Parallax Geometry in Automotive Applications29 Nov 2024
- 2024GroCo: Ground Constraint for Metric Self-Supervised Monocular Depth23 Sep 2024
- 2023Camera Height Doesn't Change: Unsupervised Training for Metric Monocular Road-Scene Depth Estimation7 Dec 2023
- 2023Exploring the Mutual Influence between Self-Supervised Single-Frame and Multi-Frame Depth Estimation25 Apr 2023
- 2023Pose Constraints for Consistent Self-supervised Monocular Depth and Ego-motion18 Apr 2023