Reinforcing Dual-Path Reasoning in Spatial Vision Language Models
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Spatial VLMs have made substantial progress in geometric perception, yet complex spatial reasoning requiring multi-step inference over depth, distance, and scene relations remains challenging. Moreover, different spatial queries call for fundamentally different strategies: some are best addressed through purely linguistic, step-by-step deduction, while others require explicit 3D grounding before quantitative inference. We present Dual-Path Spatial Reasoning via Reinforcement Learning for Spatial VLMs (SR-REAL), a unified framework that equips a spatial VLM with two complementary reasoning paths: Language-Only Reasoning (LOR), which performs step-by-step linguistic deduction, and Detect-Then-Reason (DTR), which detects 3D geometric cues (e.g., centers or bounding boxes) via region tokens before explicit geometric inference. SR-REAL begins with a cold-start supervised fine-tuning stage that constructs LOR and DTR chain-of-thought supervision and exposes a region-to-3D interface, followed by RL that optimizes the policy model with accuracy and format rewards; for DTR, a discrete center-based detection reward further refines geometric alignment. Across diverse spatial benchmarks, SR-REAL significantly outperforms spatial VLM baselines: (i) a single RL-trained model supports both reasoning paths, with DTR excelling in region-aware tasks through precise 3D localization and LOR enhancing general spatial reasoning; (ii) jointly training both paths fosters mutual reinforcement; (iii) high-quality, blended cold-start data is crucial for stable RL optimization; and (iv) the model generalizes across datasets and domains without per-task tuning, demonstrating positive transfer between LOR and DTR.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 60 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
32 of 60 references.
Closest ancestors · 11
Same direction, newest first
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
- 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning18 May
- 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning28 Apr
- 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation24 Apr
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning18 Mar
- 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
- 2024Sparkle: Mastering Basic Spatial Capabilities in Vision Language Models Elicits Generalization to Spatial Reasoning21 Oct
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
- 2023Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models18 Aug
Other references · 21
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2025s1: Simple test-time scalingcited by 1,311
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 315
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 294
- 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 178
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
- 2024Eight Methods to Evaluate Robust Unlearning in LLMscited by 153
9 more
- 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMscited by 145
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
- 2023InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Languagecited by 96
- 2025Grounded Reinforcement Learning for Visual Reasoningcited by 80
- 2024RegionGPT: Towards Region Understanding Vision Language Modelcited by 71
- 2025OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLMcited by 53
- 2024Cubify Anything: Scaling Indoor 3D Object Detectioncited by 39
- 20253D Aware Region Prompted Vision Language Modelcited by 31
- 2025Machine Learning Methods for Small Data and Upstream Bioprocessing Applications: A Comprehensive Reviewcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Make Geometry Matter for Spatial Reasoning
- 2026SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning
- 2026Self-Evolving Spatial Reasoning in Vision Language Models via Geometric Logic Consistency
- 2025Pursuing Minimal Sufficiency in Spatial Reasoning
- 2025GeoPQA: Bridging the Visual Perception Gap in MLLMs for Geometric Reasoning
- 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
- 2025SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization