FoundDP: Revisiting Weak Disparity Observability in Dual-Pixel Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Dual-pixel (DP) imaging enables metric depth estimation from a single camera using sub-aperture disparity. However, the extremely small effective baseline limits disparity observability, leading to structural degradation and depth failure in textureless, low-contrast, or downsampled regions. Existing DP-based methods rely primarily on local disparity cues and therefore become unreliable when disparity signals are weak or ambiguous. To address this limitation, we propose FoundDP, a unified framework that integrates metric DP depth with global structural priors from a monocular depth foundation model. Our method preserves metric scale through DP-derived depth and leverages Vision Transformer (ViT) features to restore structural consistency in weak-disparity regions. To ensure reliable metric guidance under DP imaging conditions, we identify and mitigate ViT representation degradation induced by DP defocus blur via ViT feature alignment, enabling stable metric-guided depth estimation. Extensive experiments on synthetic and real-world DP benchmarks show that FoundDP delivers superior performance, with consistent gains in structural fidelity and metric accuracy, especially under reduced disparity observability. Code will be available at: https://github.com/EchoLighting/FoundDP
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
31 of 47 references.
References · 31
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2018PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsingcited by 224
19 more
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
- 2021Rethinking and Improving Relative Position Encoding for Vision Transformercited by 206
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2020Defocus Deblurring Using Dual-Pixel Datacited by 138
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 73
- 2018Synthetic Depth-of-Field with a Single-Camera Mobile Phonecited by 70
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2019Learning Single Camera Depth Estimation using Dual-Pixelscited by 49
- 2020Dual Pixel Exploration: Simultaneous Depth Estimation and Image Restorationcited by 34
- 2025Depth Anything with Any Priorcited by 32
- 2021Defocus Map Estimation and Deblurring from a Single Dual-Pixel Imagecited by 25
- 2020Du2Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixelscited by 23
- 2021Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learningcited by 20
- 2023LDP: Language-driven Dual-Pixel Image Defocus Deblurring Networkcited by 11
- 2022Dual-Pixel Raindrop Removalcited by 6
- 2024Passive Snapshot Coded Aperture Dual-Pixel RGB-D Imagingcited by 6
- 2022Learning Dual-Pixel Alignment for Defocus Deblurringcited by 5
- 2023Continuous Cost Aggregation for Dual-Pixel Disparity Extractioncited by 3
- 2025Simulating Dual-Pixel Images From Ray Tracing For Depth Estimationcited by 1
Built on by
Not cited yet.