mlsanityData to 14 Oct 2026

VGLD: Visually-Guided Linguistic Disambiguation for Monocular Depth Scale Recovery

arXiv 2505.02704 ↗First posted 5 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Monocular depth estimation can be broadly categorized into two directions: relative depth estimation, which predicts normalized or inverse depth without absolute scale, and metric depth estimation, which aims to recover depth with real-world scale. While relative methods are flexible and data-efficient, their lack of metric scale limits their utility in downstream tasks. A promising solution is to infer absolute scale from textual descriptions. However, such language-based recovery is highly sensitive to natural language ambiguity, as the same image may be described differently across perspectives and styles. To address this, we introduce VGLD (Visually-Guided Linguistic Disambiguation), a framework that incorporates high-level visual semantics to resolve ambiguity in textual inputs. By jointly encoding both image and text, VGLD predicts a set of global linear transformation parameters that align relative depth maps with metric scale. This visually grounded disambiguation improves the stability and accuracy of scale estimation. We evaluate VGLD on representative models, including MiDaS and DepthAnything, using standard indoor (NYUv2) and outdoor (KITTI) benchmarks. Results show that VGLD significantly mitigates scale estimation bias caused by inconsistent or ambiguous language, achieving robust and accurate metric predictions. Moreover, when trained on multiple datasets, VGLD functions as a universal and lightweight alignment module, maintaining strong performance even in zero-shot settings. Code will be released upon acceptance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 65 references that are in the map. First posted on arXiv 5 May 2025.

Builds on

59 of 65 references.

References · 59

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  6. 2021Vision Transformers for Dense Predictioncited by 1,803
  7. 2022Visual Prompt Tuningcited by 1,681
  8. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  9. 2024Depth Anything V2cited by 1,422
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  11. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  12. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
38 more
  1. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
  2. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  3. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  4. 2021Image Segmentation Using Text and Image Promptscited by 512
  5. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
  6. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
  7. 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
  8. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  9. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  10. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
  11. 2017Sparsity Invariant CNNscited by 326
  12. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
  13. 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
  14. 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 187
  15. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
  16. 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
  17. 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
  18. 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
  19. 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 101
  20. 2024Binding Touch to Everything: Learning Unified Multimodal Tactile Representationscited by 95
  21. 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 94
  22. 2022Attention Attention Everywhere: Monocular Depth Prediction with Skip Attentioncited by 93
  23. 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 74
  24. 2022Can Language Understand Depth?cited by 69
  25. 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 61
  26. 2023VA-DepthNet: A Variational Approach to Single Image Depth Predictioncited by 54
  27. 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 52
  28. 2023All in Tokens: Unifying Output Space of Visual Tasks via Soft Tokencited by 52
  29. 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 50
  30. 2021DIML/CVL RGB-D Dataset: 2M RGB-D Images of Natural Indoor and Outdoor Scenescited by 46
  31. 2021Adaptive Surface Normal Constraint for Depth Estimationcited by 43
  32. 2023Text-image Alignment for Diffusion-based Perceptioncited by 42
  33. 2020Targeted Adversarial Perturbations for Monocular Depth Predictioncited by 40
  34. 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
  35. 2024Calibrating Multi-modal Representations: A Pursuit of Group Robustness without Annotationscited by 30
  36. 2024BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimationcited by 28
  37. 2022MGNet: Monocular Geometric Scene Understanding for Autonomous Drivingcited by 27
  38. 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 21

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.