mlsanityData to 14 Oct 2026

One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models

arXiv 2606.29600 ↗First posted 28 Jun 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

A faithful 3D world representation should account for layered geometry, where a single camera ray may contain multiple visible and geometrically valid surfaces. Monocular depth estimation, however, reduces this structure to one scalar depth per pixel. Transparent scenes make this ambiguity measurable: the same ray can pass through foreground glass and observe the background, turning the supervised target into a convention of annotation, data, and training rather than a scene-intrinsic truth. A learned predictor exposes this convention as its depth-layer preference. We introduce MultiDepth-3k (MD-3k), a sparse two-layer ordinal benchmark for measuring depth-layer preference and multi-layer spatial relationship accuracy (ML-SRA). On MD-3k, leading depth foundation models exhibit diverse layer preferences under standard RGB input, showing that the same layered geometry can be resolved differently across models. We further find that Laplacian Visual Prompting (LVP), a training-free spectral input transformation, can substantially change the reported layer for certain frozen models. The strongest RGB/LVP pair, DAv2-L, reaches 75.5% ML-SRA. These results suggest that depth foundation models may express complementary geometric hypotheses that standard RGB inference leaves unexpressed. We invite the community to rethink depth supervision and evaluation through an ambiguity-aware lens, where multiple valid 3D interpretations are treated as geometric structure to be measured, preserved, and expressed.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 59 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

32 of 59 references.

References · 32

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2021Vision Transformers for Dense Predictioncited by 1,803
  5. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  6. 2024Depth Anything V2cited by 1,422
  7. 2018Datasheets for Datasetscited by 1,386
  8. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  9. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  10. 2022MaPLe: Multi-modal Prompt Learningcited by 687
  11. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  12. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
20 more
  1. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  2. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  3. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  4. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
  5. 2022Exploring Visual Prompts for Adapting Large-Scale Modelscited by 274
  6. 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
  7. 2016Single-Image Depth Perception in the Wildcited by 180
  8. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
  9. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
  10. 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
  11. 2023Vita-CLIP: Video and text adaptive CLIP via Multimodal Promptingcited by 91
  12. 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
  13. 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
  14. 2023AD-CLIP: Adapting Domains in Prompt Space Using CLIPcited by 62
  15. 2025UniK3D: Universal Camera Monocular 3D Estimationcited by 62
  16. 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
  17. 2021Cross-modal Adversarial Reprogrammingcited by 34
  18. 2022Visual Prompting for Adversarial Robustnesscited by 34
  19. 2022TODE-Trans: Transparent Object Depth Estimation with Transformercited by 13
  20. 2025Seeing and Seeing Through the Glass: Real and Synthetic Data for Multi-Layer Depth Estimationcited by 8

Built on by

Not cited yet.