Hierarchical Awareness Adapters with Hybrid Pyramid Feature Fusion for Dense Depth Prediction
Not on the map. Why?
Abstract (arXiv)
Monocular depth estimation from a single RGB image remains a fundamental challenge in computer vision due to inherent scale ambiguity and the absence of explicit geometric cues. Existing approaches typically rely on increasingly complex network architectures to regress depth maps, which escalates training costs and computational overhead without fully exploiting inter-pixel spatial dependencies. We propose a multilevel perceptual conditional random field (CRF) model built upon the Swin Transformer backbone that addresses these limitations through three synergistic innovations: (1) an adaptive hybrid pyramid feature fusion (HPF) strategy that captures both short-range and long-range dependencies by combining multi-scale spatial pyramid pooling with biaxial feature aggregation, enabling effective integration of global and local contextual information; (2) a hierarchical awareness adapter (HA) that enriches cross-level feature interactions within the encoder through lightweight broadcast modules with learnable dimensional scaling, reducing computational complexity while enhancing representational capacity; and (3) a fully-connected CRF decoder with dynamic scaling attention that models fine-grained pixel-level spatial relationships, incorporating a bias learning unit to prevent extreme-value collapse and ensure stable training. Extensive experiments on NYU Depth v2, KITTI, and MatterPort3D datasets demonstrate that our method achieves state-of-the-art performance, reducing Abs Rel to 0.088 (-7.4%) and RMSE to 0.316 (-5.4%) on NYU Depth v2, while attaining near-perfect threshold accuracy (δ < 1.253 ≈ 99.8%) on KITTI with only 194M parameters and 21ms inference time.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 60 of its 69 references that are in the map. First posted on arXiv 3 Apr 2026.
Builds on
60 of 69 references.
References · 60
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
38 more
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2020HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matchingcited by 120
- 2022DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimationcited by 116
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2022Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimationcited by 100
- 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
- 2022Attention Attention Everywhere: Monocular Depth Prediction with Skip Attentioncited by 92
- 2020Guiding Monocular Depth Estimation Using Depth-Attention Volumecited by 82
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 70
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
- 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
- 2024Harmonizing Visual Text Comprehension and Generationcited by 54
- 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
- 2020Bidirectional Attention Network for Monocular Depth Estimationcited by 48
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimationcited by 45
- 2023Improving Deep Regression with Ordinal Entropycited by 44
- 2021Adaptive Surface Normal Constraint for Depth Estimationcited by 43
- 2021Sparse Auxiliary Networks for Unified Monocular Depth Prediction and Completioncited by 39
- 2025Vision as LoRAcited by 37
- 2025Prolonged Reasoning Is Not All You Need: Certainty-Based Adaptive Routing for Efficient LLM/MLLM Reasoningcited by 34
- 2022Optimal Boxes: Boosting End-to-End Scene Text Recognition by Adjusting Annotated Bounding Boxes via Reinforcement Learningcited by 33
- 2018Detail Preserving Depth Estimation from a Single Image Using Attention Guided Networkscited by 31
- 2024MCTBench: Multimodal Cognition towards Text-Rich Visual Scenes Benchmarkcited by 26
- 2025WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild?cited by 26
50 most cited of 60 All 60 (JSON)
Built on by
Not cited yet.