mlsanityData to 7 Oct 2026

FoundDP: Revisiting Weak Disparity Observability in Dual-Pixel Depth Estimation

arXiv 2607.01900 ↗First posted 2 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Dual-pixel (DP) imaging enables metric depth estimation from a single camera using sub-aperture disparity. However, the extremely small effective baseline limits disparity observability, leading to structural degradation and depth failure in textureless, low-contrast, or downsampled regions. Existing DP-based methods rely primarily on local disparity cues and therefore become unreliable when disparity signals are weak or ambiguous. To address this limitation, we propose FoundDP, a unified framework that integrates metric DP depth with global structural priors from a monocular depth foundation model. Our method preserves metric scale through DP-derived depth and leverages Vision Transformer (ViT) features to restore structural consistency in weak-disparity regions. To ensure reliable metric guidance under DP imaging conditions, we identify and mitigate ViT representation degradation induced by DP defocus blur via ViT feature alignment, enabling stable metric-guided depth estimation. Extensive experiments on synthetic and real-world DP benchmarks show that FoundDP delivers superior performance, with consistent gains in structural fidelity and metric accuracy, especially under reduced disparity observability. Code will be available at: https://github.com/EchoLighting/FoundDP

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

31 of 47 references.

References · 31

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Vision Transformers for Dense Predictioncited by 1,789
  3. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  4. 2024Depth Anything V2cited by 1,385
  5. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  6. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  7. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  8. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  9. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
  10. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  11. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  12. 2018PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsingcited by 224
19 more
  1. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  2. 2021Rethinking and Improving Relative Position Encoding for Vision Transformercited by 206
  3. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
  4. 2020Defocus Deblurring Using Dual-Pixel Datacited by 138
  5. 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 73
  6. 2018Synthetic Depth-of-Field with a Single-Camera Mobile Phonecited by 70
  7. 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
  8. 2019Learning Single Camera Depth Estimation using Dual-Pixelscited by 49
  9. 2020Dual Pixel Exploration: Simultaneous Depth Estimation and Image Restorationcited by 34
  10. 2025Depth Anything with Any Priorcited by 32
  11. 2021Defocus Map Estimation and Deblurring from a Single Dual-Pixel Imagecited by 25
  12. 2020Du2Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixelscited by 23
  13. 2021Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learningcited by 20
  14. 2023LDP: Language-driven Dual-Pixel Image Defocus Deblurring Networkcited by 11
  15. 2022Dual-Pixel Raindrop Removalcited by 6
  16. 2024Passive Snapshot Coded Aperture Dual-Pixel RGB-D Imagingcited by 6
  17. 2022Learning Dual-Pixel Alignment for Defocus Deblurringcited by 5
  18. 2023Continuous Cost Aggregation for Dual-Pixel Disparity Extractioncited by 3
  19. 2025Simulating Dual-Pixel Images From Ray Tracing For Depth Estimationcited by 1

Built on by

Not cited yet.