HybridDepth: Robust Metric Depth Fusion by Leveraging Depth from Focus and Single-Image Priors
Not on the map. Why?
Abstract (arXiv)
We propose HYBRIDDEPTH, a robust depth estimation pipeline that addresses key challenges in depth estimation,including scale ambiguity, hardware heterogeneity, and generalizability. HYBRIDDEPTH leverages focal stack, data conveniently accessible in common mobile devices, to produce accurate metric depth maps. By incorporating depth priors afforded by recent advances in singleimage depth estimation, our model achieves a higher level of structural detail compared to existing methods. We test our pipeline as an end-to-end system, with a newly developed mobile client to capture focal stacks, which are then sent to a GPU-powered server for depth estimation. Comprehensive quantitative and qualitative analyses demonstrate that HYBRIDDEPTH outperforms state-of-the-art(SOTA) models on common datasets such as DDFF12 and NYU Depth V2. HYBRIDDEPTH also shows strong zero-shot generalization. When trained on NYU Depth V2, HYBRIDDEPTH surpasses SOTA models in zero-shot performance on ARKitScenes and delivers more structurally accurate depth maps on Mobile Depth. The code is available at https://github.com/cake-lab/HybridDepth/.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 26 Jul 2024.
Builds on
23 of 32 references.
References · 23
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 266
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimationcited by 45
11 more
- 2021Toward Practical Monocular Indoor Depth Estimationcited by 42
- 2020Focus on defocus: bridging the synthetic to real domain gap for depth estimationcited by 37
- 2017Deep Depth From Focuscited by 28
- 2021Bridging Unsupervised and Supervised Depth from Focus via All-in-Focus Supervisioncited by 23
- 2021Deep Depth from Focus with Differential Focus Volumecited by 20
- 2023Monocular Visual-Inertial Depth Estimationcited by 18
- 2023Fully Self-Supervised Depth Estimation from Defocus Cluecited by 17
- 2014Variational Depth from Focus Reconstructioncited by 15
- 2022Learning Depth from Focus in the Wildcited by 8
- 2023DeepPointMap: Advancing LiDAR SLAM with Unified Neural Descriptorscited by 2
- 2024Attention and Sensory Processing in Augmented Reality: Empowering ADHD populationcited by 1
Built on by
Citing papers per year: 2025: 5; 2026: 6.
11 papers.
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Framescited by 3
- 2025HybridFlow: Quantification of Aleatoric and Epistemic Uncertainty with a Single Hybrid Modelcited by 3
- 2025SingRef6D: Monocular Novel Object Pose Estimation with a Single RGB Referencecited by 1
- 2025DualFocus: Depth from Focus with Spatio-Focal Dual Variational Constraintscited by 1
- 2025AR as an Evaluation Playground: Bridging Metrics and Visual Perception of Computer Vision Modelscited by 0
- 2026SwiftNDC: Fast Neural Depth Correction for High-Fidelity 3D Reconstructioncited by 0
- 2026Long-Term Visual Localization in Dynamic Benthic Environments: A Dataset, Footprint-Based Ground Truth, and Visual Place Recognition Benchmarkcited by 0
- 2026Zero-Shot Depth from Defocuscited by 0
- 2026Towards Minimal Focal Stack in Shape from Focuscited by 0
- 2026Enhancing Hazy Wildlife Imagery: AnimalHaze3k and IncepDehazeGancited by 0
- 2026Enhancing Visual Perception in Foggy Conditions via Multiclass Fog Density Modelingcited by 0
- 2026Enhancing Visual Perception in Foggy Conditions via Multiclass Fog Density Modeling3 Aug 2026
- 2026Enhancing Hazy Wildlife Imagery: AnimalHaze3k and IncepDehazeGan17 Apr 2026
- 2026Towards Minimal Focal Stack in Shape from Focus2 Apr 2026
- 2026Zero-Shot Depth from Defocus27 Mar 2026
- 2026Long-Term Visual Localization in Dynamic Benthic Environments: A Dataset, Footprint-Based Ground Truth, and Visual Place Recognition Benchmark4 Mar 2026
- 2026SwiftNDC: Fast Neural Depth Correction for High-Fidelity 3D Reconstruction26 Feb 2026
- 2025HybridFlow: Quantification of Aleatoric and Epistemic Uncertainty with a Single Hybrid Model6 Oct 2025
- 2025DualFocus: Depth from Focus with Spatio-Focal Dual Variational Constraints26 Sep 2025
- 2025SingRef6D: Monocular Novel Object Pose Estimation with a Single RGB Reference26 Sep 2025
- 2025AR as an Evaluation Playground: Bridging Metrics and Visual Perception of Computer Vision Models6 Aug 2025
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames5 Mar 2025