mlsanityData to 7 Oct 2026

GaugeVLM: Structuring Spatial Supervision with Measured Geometric Interventions

arXiv 2609.38285 ↗First posted 29 Sep 2026cs.CV cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Vision-language models (VLMs) can contradict themselves across views of the same spatial relation and fail to respond when that relation changes. Addressing these failures requires supervision that captures error magnitude and geometric dependencies across observations, both of which remain implicit in training on individual answers or ordinal preferences. Therefore, we introduce GaugeVLM, which makes this structure explicit through controlled object and camera interventions in explicit 3D scenes, producing linked observations with measured differences between spatial relations and shared truths across views. To translate this structure into learning signals, its core objective, GaugeDPO, converts measured errors into preference margins, directly supervises correct canonical rankings across views, and links intervention-induced answer-odds contrasts to measured relation changes with view-specific scales. Our analysis bounds canonical prediction error and establishes that the cross-view and intervention constraints can be jointly satisfied. Empirically, GaugeVLM improves all 10 established spatial metrics over supervised fine-tuning across three VLM backbones, with the main 7B model gaining 15.0 and 18.9 percentage points on MSMU distance and QSpatial+, respectively. These gains also extend to autonomous driving and embodied reasoning, demonstrating the robust generalization across domains.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 44 of its 55 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

44 of 55 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos1 Jul
  2. 2026Consistent Yet Wrong: Evidence Insensitivity in Spatial Vision-Language Models1 Jun
  3. 2026Smooth Operator: Smooth Verifiable Reward Activates Spatial Reasoning Ability of Vision-Language Model12 Jan
  4. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  5. 2025SD-VLM: Spatial Measuring and Understanding with Depth-Encoded Vision-Language Models22 Sep
  6. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning1 Jul
  7. 2025Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMs26 Jun
  8. 2025MindCube: Spatial Mental Modeling from Limited Views26 Jun
  9. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
  10. 2025SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization2 Jun
  11. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  12. 2025SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data29 Apr
7 more
  1. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D29 Mar
  2. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  3. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics25 Nov
  4. 2024SURDS: Benchmarking Spatial Understanding and Reasoning in Driving Scenarios with Vision Language Models20 Nov
  5. 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models15 Sep
  6. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  7. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 25

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  4. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  5. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  6. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  7. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  8. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  9. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
  10. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
  11. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  12. 2016A Diagram Is Worth A Dozen Imagescited by 793
13 more
  1. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
  2. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  3. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  4. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
  5. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 133
  6. 2024Direct Preference Optimization with an Offsetcited by 122
  7. 2024mDPO: Conditional Preference Optimization for Multimodal Large Language Modelscited by 92
  8. 2025Visual Spatial Tuningcited by 85
  9. 2023Equivariant Similarity for Vision-Language Foundation Modelscited by 51
  10. 2025Visual Agentic AI for Spatial Reasoning with a Dynamic APIcited by 42
  11. 2024AlphaDPO: Adaptive Reward Margin for Direct Preference Optimizationcited by 27
  12. 2025Scaling Spatial Reasoning in MLLMs through Programmatic Data Synthesiscited by 3
  13. 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025GRAID: Enhancing Spatial Reasoning of VLMs Through High-Fidelity Data Generation
  2. 2026Reinforcing Dual-Path Reasoning in Spatial Vision Language Models
  3. 20253D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
  4. 2026Render to Reason: Novel-View Semantic Prediction Improves Spatial Understanding in VLMs
  5. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Data
  6. 2026Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning
  7. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens
  8. 2026SpatialChain: A Benchmark for Auditing Spatial Reasoning Faithfulness in VLMs