VGLD: Visually-Guided Linguistic Disambiguation for Monocular Depth Scale Recovery
Not on the map. Why?
Abstract (arXiv)
Monocular depth estimation can be broadly categorized into two directions: relative depth estimation, which predicts normalized or inverse depth without absolute scale, and metric depth estimation, which aims to recover depth with real-world scale. While relative methods are flexible and data-efficient, their lack of metric scale limits their utility in downstream tasks. A promising solution is to infer absolute scale from textual descriptions. However, such language-based recovery is highly sensitive to natural language ambiguity, as the same image may be described differently across perspectives and styles. To address this, we introduce VGLD (Visually-Guided Linguistic Disambiguation), a framework that incorporates high-level visual semantics to resolve ambiguity in textual inputs. By jointly encoding both image and text, VGLD predicts a set of global linear transformation parameters that align relative depth maps with metric scale. This visually grounded disambiguation improves the stability and accuracy of scale estimation. We evaluate VGLD on representative models, including MiDaS and DepthAnything, using standard indoor (NYUv2) and outdoor (KITTI) benchmarks. Results show that VGLD significantly mitigates scale estimation bias caused by inconsistent or ambiguous language, achieving robust and accurate metric predictions. Moreover, when trained on multiple datasets, VGLD functions as a universal and lightweight alignment module, maintaining strong performance even in zero-shot settings. Code will be released upon acceptance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 65 references that are in the map. First posted on arXiv 5 May 2025.
Builds on
59 of 65 references.
References · 59
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2022Visual Prompt Tuningcited by 1,681
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
38 more
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2017Sparsity Invariant CNNscited by 326
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
- 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 187
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 101
- 2024Binding Touch to Everything: Learning Unified Multimodal Tactile Representationscited by 95
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 94
- 2022Attention Attention Everywhere: Monocular Depth Prediction with Skip Attentioncited by 93
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 74
- 2022Can Language Understand Depth?cited by 69
- 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 61
- 2023VA-DepthNet: A Variational Approach to Single Image Depth Predictioncited by 54
- 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 52
- 2023All in Tokens: Unifying Output Space of Visual Tasks via Soft Tokencited by 52
- 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 50
- 2021DIML/CVL RGB-D Dataset: 2M RGB-D Images of Natural Indoor and Outdoor Scenescited by 46
- 2021Adaptive Surface Normal Constraint for Depth Estimationcited by 43
- 2023Text-image Alignment for Diffusion-based Perceptioncited by 42
- 2020Targeted Adversarial Perturbations for Monocular Depth Predictioncited by 40
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
- 2024Calibrating Multi-modal Representations: A Pursuit of Group Robustness without Annotationscited by 30
- 2024BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimationcited by 28
- 2022MGNet: Monocular Geometric Scene Understanding for Autonomous Drivingcited by 27
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 21
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.