mlsanityData to 7 Oct 2026

HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decoder

arXiv 2305.18706 ↗First posted 30 May 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Decoders play significant roles in recovering scene depths. However, the decoders used in previous works ignore the propagation of multilevel lossless fine-grained information, cannot adaptively capture local and global information in parallel, and cannot perform sufficient global statistical analyses on the final output disparities. In addition, the process of mapping from a low-resolution feature space to a high-resolution feature space is a one-to-many problem that may have multiple solutions. Therefore, the quality of the recovered depth map is low. To this end, we propose a high-quality decoder (HQDec), with which multilevel near-lossless fine-grained information, obtained by the proposed adaptive axial-normalized position-embedded channel attention sampling module (AdaAxialNPCAS), can be adaptively incorporated into a low-resolution feature map with high-level semantics utilizing the proposed adaptive information exchange scheme. In the HQDec, we leverage the proposed adaptive refinement module (AdaRM) to model the local and global dependencies between pixels in parallel and utilize the proposed disparity attention module to model the distribution characteristics of disparity values from a global perspective. To recover fine-grained high-resolution features with maximal accuracy, we adaptively fuse the high-frequency information obtained by constraining the upsampled solution space utilizing the local and global dependencies between pixels into the high-resolution feature map generated from the nonlearning method. Extensive experiments demonstrate that each proposed component improves the quality of the depth estimation results over the baseline results, and the developed approach achieves state-of-the-art results on the KITTI and DDAD datasets. The code and models will be publicly available at hrefhttps://github.com/fwucas/HQDecHQDec.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 70 of its 96 references that are in the map. First posted on arXiv 30 May 2023.

Builds on

70 of 96 references.

References · 70

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2016Densely Connected Convolutional Networkscited by 6,691
  7. 2017Squeeze-and-Excitation Networkscited by 4,763
  8. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  9. 2021Vision Transformers for Dense Predictioncited by 1,789
  10. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
  11. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
  12. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
38 more
  1. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  2. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
  3. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  4. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  5. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  6. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
  7. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
  8. 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
  9. 2019Deep Learning for Image Super-resolution: A Surveycited by 368
  10. 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
  11. 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 331
  12. 2017Sparsity Invariant CNNscited by 325
  13. 2017Dilated Residual Networkscited by 293
  14. 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
  15. 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
  16. 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
  17. 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
  18. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  19. 2015Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fieldscited by 169
  20. 2018Depth Prediction Without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videoscited by 155
  21. 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
  22. 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
  23. 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
  24. 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
  25. 2019Self-Supervised Monocular Depth Hintscited by 127
  26. 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
  27. 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
  28. 2020Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volumecited by 116
  29. 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
  30. 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
  31. 2018Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understandingcited by 101
  32. 2020Unsupervised Monocular Depth Learning in Dynamic Scenescited by 84
  33. 2020Guiding Monocular Depth Estimation Using Depth-Attention Volumecited by 82
  34. 2016Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challengecited by 70
  35. 2021Self-Supervised Monocular Depth and Ego-Motion Estimation in Endoscopy: Appearance Flow to the Rescuecited by 70
  36. 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
  37. 2021Self-Supervised Monocular Depth Estimation with Internal Feature Fusioncited by 67
  38. 2018SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimationcited by 64

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.