mlsanityData to 7 Oct 2026

Towards Ambiguity-Free Spatial Foundation Model: Rethinking and Decoupling Depth Ambiguity

arXiv 2503.06014 ↗First posted 8 Mar 2025cs.CV cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Depth ambiguity is a fundamental challenge in spatial scene understanding, especially in transparent scenes where single-depth estimates fail to capture full 3D structure. Existing models, limited to deterministic predictions, overlook real-world multi-layer depth. To address this, we introduce a paradigm shift from single-prediction to multi-hypothesis spatial foundation models. We first present textttMD-3k, a benchmark exposing depth biases in expert and foundational models through multi-layer spatial relationship labels and new metrics. To resolve depth ambiguity, we propose Laplacian Visual Prompting (LVP), a training-free spectral prompting technique that extracts hidden depth from pre-trained models via Laplacian-transformed RGB inputs. By integrating LVP-inferred depth with standard RGB-based estimates, our approach elicits multi-layer depth without model retraining. Extensive experiments validate the effectiveness of LVP in zero-shot multi-layer depth estimation, unlocking more robust and comprehensive geometry-conditioned visual generation, 3D-grounded spatial reasoning, and temporally consistent video-level depth inference. Our benchmark and code will be available at https://github.com/Xiaohao-Xu/Ambiguity-in-Space.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 8 Mar 2025.

Builds on

33 of 58 references.

References · 33

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2021Vision Transformers for Dense Predictioncited by 1,789
  6. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  7. 2024Depth Anything V2cited by 1,385
  8. 2018Datasheets for Datasetscited by 1,371
  9. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  10. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  11. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  12. 2022MaPLe: Multi-modal Prompt Learningcited by 685
21 more
  1. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  2. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
  3. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  4. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  5. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  6. 2022Exploring Visual Prompts for Adapting Large-Scale Modelscited by 271
  7. 2022Visual Prompting via Image Inpaintingcited by 248
  8. 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
  9. 2016Single-Image Depth Perception in the Wildcited by 179
  10. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
  11. 2023Scaling Laws of Synthetic Images for Model Training ... for Nowcited by 107
  12. 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
  13. 2023Vita-CLIP: Video and text adaptive CLIP via Multimodal Promptingcited by 90
  14. 2020Transfer Learning without Knowing: Reprogramming Black-box Machine Learning Models with Scarce Data and Limited Resourcescited by 83
  15. 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
  16. 2023AD-CLIP: Adapting Domains in Prompt Space Using CLIPcited by 62
  17. 2023PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimationcited by 39
  18. 2021Cross-modal Adversarial Reprogrammingcited by 34
  19. 2022Visual Prompting for Adversarial Robustnesscited by 33
  20. 2025Understanding the Emergence of Multimodal Representation Alignmentcited by 28
  21. 2024Finding Visual Task Vectorscited by 24

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026When Depth Is Better Told Than Shown: Depth-Ordinal Prompting for Vision-Language Spatial Reasoning
  2. 2026Unified 3D Scene Understanding Through Physical World Modeling
  3. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMs
  4. 20263D-IDE: 3D Implicit Depth Emergent
  5. 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning
  6. 2026UniGround: Universal 3D Visual Grounding via Training-Free Scene Parsing
  7. 2025Leveraging Stable Diffusion for Monocular Depth Estimation via Image Semantic Encoding
  8. 2025DidSee: Diffusion-Based Depth Completion for Material-Agnostic Robotic Perception and Manipulation