HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decoder
Not on the map. Why?
Abstract (arXiv)
Decoders play significant roles in recovering scene depths. However, the decoders used in previous works ignore the propagation of multilevel lossless fine-grained information, cannot adaptively capture local and global information in parallel, and cannot perform sufficient global statistical analyses on the final output disparities. In addition, the process of mapping from a low-resolution feature space to a high-resolution feature space is a one-to-many problem that may have multiple solutions. Therefore, the quality of the recovered depth map is low. To this end, we propose a high-quality decoder (HQDec), with which multilevel near-lossless fine-grained information, obtained by the proposed adaptive axial-normalized position-embedded channel attention sampling module (AdaAxialNPCAS), can be adaptively incorporated into a low-resolution feature map with high-level semantics utilizing the proposed adaptive information exchange scheme. In the HQDec, we leverage the proposed adaptive refinement module (AdaRM) to model the local and global dependencies between pixels in parallel and utilize the proposed disparity attention module to model the distribution characteristics of disparity values from a global perspective. To recover fine-grained high-resolution features with maximal accuracy, we adaptively fuse the high-frequency information obtained by constraining the upsampled solution space utilizing the local and global dependencies between pixels into the high-resolution feature map generated from the nonlearning method. Extensive experiments demonstrate that each proposed component improves the quality of the depth estimation results over the baseline results, and the developed approach achieves state-of-the-art results on the KITTI and DDAD datasets. The code and models will be publicly available at hrefhttps://github.com/fwucas/HQDecHQDec.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 70 of its 96 references that are in the map. First posted on arXiv 30 May 2023.
Builds on
70 of 96 references.
References · 70
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
38 more
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2019Deep Learning for Image Super-resolution: A Surveycited by 368
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 331
- 2017Sparsity Invariant CNNscited by 325
- 2017Dilated Residual Networkscited by 293
- 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
- 2015Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fieldscited by 169
- 2018Depth Prediction Without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videoscited by 155
- 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
- 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
- 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
- 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
- 2019Self-Supervised Monocular Depth Hintscited by 127
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
- 2020Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volumecited by 116
- 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
- 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
- 2018Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understandingcited by 101
- 2020Unsupervised Monocular Depth Learning in Dynamic Scenescited by 84
- 2020Guiding Monocular Depth Estimation Using Depth-Attention Volumecited by 82
- 2016Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challengecited by 70
- 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
- 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
- 2021Self-Supervised Monocular Depth Estimation with Internal Feature Fusioncited by 67
- 2018SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimationcited by 64
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2024: 1.
1 paper.