mlsanityData to 14 Oct 2026

SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards

arXiv 2511.07403 ↗First posted 10 Nov 2025cs.CV cs.AI cs.CLcited by 16

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language tasks, but continue to struggle with spatial reasoning. Existing spatial MLLMs rely on large-scale datasets, explicit 3D inputs, architecture-specific modifications, or sparse Reinforcement Learning (RL) methods that provide insufficient guidance for spatially-grounded reasoning. We introduce SpatialThinker. To our knowledge, it is the first MLLM unifying Scene Graph Generation (SGG) and visual reasoning in a single pass via online RL. The model simulates human-like spatial perception by constructing a mental scene graph of task-relevant objects and relations, and reasoning toward an answer via dense spatial rewards. Our contributions are threefold: (1) SGG-grounded reasoning: integrating SGG directly within the reasoning chain rather than as a disjoint preprocessing step; (2) STVQA-7K: a high-quality spatial VQA training dataset via a scalable synthesis pipeline; and (3) a dense spatial reward design that enforces structured grounding during RL and generalizes to improve broad visual perception. SpatialThinker-7B achieves 3.6× larger gains over SFT and 1.7× better in- and out-of-distribution generalization than sparse RL. Trained on only 7K samples, SpatialThinker-7B matches GPT-5 and outperforms GPT-4o, while SpatialThinker-30B surpasses both GPT-5 and Claude 4 Sonnet on average across 14 spatial and real-world benchmarks, demonstrating that structured spatial grounding with reward-aligned reasoning enables robust spatial understanding with limited data.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 56 of its 96 references that are in the map. First posted on arXiv 10 Nov 2025.

Builds on

56 of 96 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Struct2D: A Perception-Guided Framework for Spatial Reasoning in MLLMs4 Jun
  2. 2025SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization2 Jun
  3. 2025SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data29 Apr
  4. 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning28 Apr
  5. 2025LEGO-Puzzles: How Good Are MLLMs at Multi-Step Spatial Reasoning?25 Mar
  6. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec
  7. 2024TopViewRS: Vision-Language Models as Top-View Spatial Reasoners4 Jun
  8. 2024PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs12 Feb
  9. 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoning30 Oct

Other references · 47

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  8. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  9. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  10. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  11. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  12. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
35 more
  1. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  2. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  3. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  4. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  5. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
  6. 2025Kimi-VL Technical Reportcited by 388
  7. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
  8. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
  9. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
  10. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  11. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
  12. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
  13. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Modelscited by 212
  14. 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
  15. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
  16. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
  17. 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learningcited by 87
  18. 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 83
  19. 2024Correcting the Mythos of KL-Regularization: Direct Alignment without Overoptimization via Chi-Squared Preference Optimizationcited by 78
  20. 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 77
  21. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 73
  22. 2023Evaluating Spatial Understanding of Large Language Modelscited by 66
  23. 2020Scene Graph Reasoning for Visual Question Answeringcited by 50
  24. 2025Perception-R1: Advancing Multimodal Reasoning Capabilities of MLLMs via Visual Perception Rewardcited by 45
  25. 2023Tuning computer vision models with task rewardscited by 37
  26. 2025Ignore the KL Penalty! Boosting Exploration on Critical Tokens to Enhance RL Fine-Tuningcited by 34
  27. 2023Zero-shot Visual Relation Detection via Composite Visual Cues from Large Language Modelscited by 27
  28. 2024Compositional 4D Dynamic Scenes Understanding with Physics Priors for Video Question Answeringcited by 18
  29. 2022Lexicographic Multi-Objective Reinforcement Learningcited by 17
  30. 2025SATORI-R1: Incentivizing Multimodal Reasoning through Explicit Visual Anchoringcited by 17
  31. 2024Scene Graph Generation with Role-Playing Large Language Modelscited by 16
  32. 2025Compile Scene Graphs with Reinforcement Learningcited by 11
  33. 2024VR-GPT: Visual Language Model for Intelligent Virtual Reality Applicationscited by 9
  34. 2025Relation-R1: Progressively Cognitive Chain-of-Thought Guided Reinforcement Learning for Unified Relation Comprehensioncited by 9
  35. 2023GPT4SGG: Synthesizing Scene Graphs from Holistic and Region-specific Narrativescited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

  1. 2026Spa3R: Predictive Spatial Field Modeling for 3D Visual Reasoningcited by 6
  2. 2026Allocentric Perceiver: Disentangling Allocentric Reasoning from Egocentric Visual Priors via Frame Instantiationcited by 5
  3. 2026OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mappingcited by 2
  4. 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMscited by 2
  5. 2026Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Textcited by 2
  6. 2026AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoningcited by 1
  7. 2026SPATIALALIGN: Aligning Dynamic Spatial Relationships in Video Generationcited by 0
  8. 2026SaFeR-ToolKit: Structured Reasoning via Virtual Tool Calling for Multimodal Safetycited by 0
  9. 2026SpatiO: Adaptive Test-Time Orchestration of Vision-Language Agents for Spatial Reasoningcited by 0
  10. 2026Rethinking VLM Representation for VLA Initializationcited by 0
  11. 2026Geo3R: Mitigating Spatial Reasoning Hallucination in Multimodal Large Language Modelscited by 0
  12. 2026SCOUT: Unlocking Enhanced Spatial Reasoning via Structured Chain-of-Thought and Multi-Objective Process Rewardcited by 0
4 more
  1. 2026Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoningcited by 0
  2. 2026Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Modelscited by 0
  3. 2026HumanPhys: A Human-Centric Physical-World Perception Benchmark for Real-World Visual Reasoningcited by 0
  4. 2026Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models
  2. 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Models
  3. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models
  4. 2026When More Is Less: A Systematic Analysis of Spatial and Commonsense Information for Visual Spatial Reasoning
  5. 2026Faithful GRPO: Improving Visual Spatial Reasoning in Multimodal Language Models via Constrained Policy Optimization
  6. 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
  7. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
  8. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks