One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models
Not on the map. Why?
Abstract (arXiv)
A faithful 3D world representation should account for layered geometry, where a single camera ray may contain multiple visible and geometrically valid surfaces. Monocular depth estimation, however, reduces this structure to one scalar depth per pixel. Transparent scenes make this ambiguity measurable: the same ray can pass through foreground glass and observe the background, turning the supervised target into a convention of annotation, data, and training rather than a scene-intrinsic truth. A learned predictor exposes this convention as its depth-layer preference. We introduce MultiDepth-3k (MD-3k), a sparse two-layer ordinal benchmark for measuring depth-layer preference and multi-layer spatial relationship accuracy (ML-SRA). On MD-3k, leading depth foundation models exhibit diverse layer preferences under standard RGB input, showing that the same layered geometry can be resolved differently across models. We further find that Laplacian Visual Prompting (LVP), a training-free spectral input transformation, can substantially change the reported layer for certain frozen models. The strongest RGB/LVP pair, DAv2-L, reaches 75.5% ML-SRA. These results suggest that depth foundation models may express complementary geometric hypotheses that standard RGB inference leaves unexpressed. We invite the community to rethink depth supervision and evaluation through an ambiguity-aware lens, where multiple valid 3D interpretations are treated as geometric structure to be measured, preserved, and expressed.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 59 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
32 of 59 references.
References · 32
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2018Datasheets for Datasetscited by 1,386
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2022MaPLe: Multi-modal Prompt Learningcited by 687
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
20 more
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2022Exploring Visual Prompts for Adapting Large-Scale Modelscited by 274
- 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
- 2016Single-Image Depth Perception in the Wildcited by 180
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
- 2023Vita-CLIP: Video and text adaptive CLIP via Multimodal Promptingcited by 91
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2023AD-CLIP: Adapting Domains in Prompt Space Using CLIPcited by 62
- 2025UniK3D: Universal Camera Monocular 3D Estimationcited by 62
- 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
- 2021Cross-modal Adversarial Reprogrammingcited by 34
- 2022Visual Prompting for Adversarial Robustnesscited by 34
- 2022TODE-Trans: Transparent Object Depth Estimation with Transformercited by 13
- 2025Seeing and Seeing Through the Glass: Real and Synthetic Data for Multi-Layer Depth Estimationcited by 8
Built on by
Not cited yet.