mlsanityData to 7 Oct 2026

SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models

arXiv 2510.08531 ↗First posted 9 Oct 2025cs.CV cs.AI cs.CLcited by 83

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Spatial reasoning remains a fundamental challenge for Vision-Language Models (VLMs), with current approaches struggling to achieve robust performance despite recent advances. We identify that this limitation stems from a critical gap: existing methods attempt to learn spatial reasoning directly without establishing the hierarchical foundations of perception and understanding. To address this challenge, we present a comprehensive methodology for building spatial intelligence progressively. We introduce SpatialLadder-26k, a multimodal dataset containing 26,610 samples spanning object localization, single image, multi-view, and video spatial reasoning tasks, constructed through a standardized pipeline that ensures systematic coverage across modalities. Building on this dataset, we design a three-stage progressive training framework that (1) establishes spatial perception through object localization, (2) develops spatial understanding through multi-dimensional spatial tasks, and (3) strengthens complex reasoning via reinforcement learning with verifiable rewards. This approach yields SpatialLadder, a 3B-parameter model that achieves state-of-the-art performance on spatial reasoning benchmarks, with 23.4% average improvement over the base model, surpassing GPT-4o by 20.8% and Gemini-2.0-Flash by 10.1%. Notably, SpatialLadder maintains strong generalization with 7.2% improvement on out-of-domain benchmarks, demonstrating that progressive training from perception to reasoning is essential for robust spatial intelligence.

Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 47 of its 52 references that are in the map. First posted on arXiv 9 Oct 2025.

Builds on

47 of 52 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  2. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  3. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  4. 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr
  5. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  6. 2024Coarse Correspondences Boost Spatial-Temporal Reasoning in Multimodal Language Model1 Aug
  7. 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoning30 Oct

Other references · 40

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2024GPT-4o System Cardcited by 4,467
  8. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  9. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  10. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  11. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  12. 2024Mixtral of Expertscited by 1,785
28 more
  1. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  2. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  3. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  4. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
  5. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  6. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  7. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
  8. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 515
  9. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  10. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  11. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  12. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
  13. 2025Kimi-VL Technical Reportcited by 381
  14. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
  15. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
  16. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
  17. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  18. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
  19. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 178
  20. 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
  21. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 131
  22. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
  23. 2025GRIT: Teaching MLLMs to Think with Imagescited by 121
  24. 2025Perception-R1: Pioneering Perception Policy with Reinforcement Learningcited by 116
  25. 2024HourVideo: 1-Hour Video-Language Understandingcited by 110
  26. 2025Self-Rewarding Vision-Language Model via Reasoning Decompositioncited by 95
  27. 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 74
  28. 2025Perception Before Reasoning: Two-Stage Reinforcement Learning for Visual Reasoning in Vision-Language Modelscited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 10; 2026: 73.

83 papers.

Sort:

By area:

  1. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 75
  2. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 58
  3. 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 38
  4. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognitioncited by 35
  5. 2025N3D-VLM: Native 3D Grounding Enables Accurate Spatial Reasoning in Vision-Language Modelscited by 28
  6. 2025Geometrically-Constrained Agent for Spatial Reasoningcited by 25
  7. 2025SpaceMind: Camera-Guided Modality Fusion for Spatial Reasoning in Vision-Language Modelscited by 21
  8. 2026Thinking with Geometry: Active Geometry Integration for Spatial Reasoningcited by 14
  9. 2026Thinking in Dynamics: How Multimodal Large Language Models Perceive, Track, and Reason Dynamics in Physical 4D Worldcited by 11
  10. 2026Spatial-TTT: Streaming Visual-based Spatial Intelligence with Test-Time Trainingcited by 8
  11. 2025Beyond Flatlands: Unlocking Spatial Intelligence by Decoupling 3D Reasoning from Numerical Regressioncited by 7
  12. 2026Thinking with Spatial Code for Physical-World Video Reasoningcited by 7
38 more
  1. 2026Spa3R: Predictive Spatial Field Modeling for 3D Visual Reasoningcited by 6
  2. 2026Allocentric Perceiver: Disentangling Allocentric Reasoning from Egocentric Visual Priors via Frame Instantiationcited by 5
  3. 20263ViewSense: Spatial and Mental Perspective Reasoning from Orthographic Views in Vision-Language Modelscited by 4
  4. 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understandingcited by 4
  5. 2026OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligencecited by 4
  6. 2026SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environmentscited by 4
  7. 2026Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulatorscited by 4
  8. 2025MonoSR: Open-Vocabulary Spatial Reasoning from Monocular Imagescited by 3
  9. 2026EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMscited by 3
  10. 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
  11. 2026World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoningcited by 3
  12. 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understandingcited by 3
  13. 2026ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Modelscited by 3
  14. 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
  15. 2026Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streamscited by 3
  16. 2026Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoningcited by 3
  17. 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Modelscited by 2
  18. 2026Stepping VLMs onto the Court: Benchmarking Spatial Intelligence in Sportscited by 2
  19. 2026LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Modelscited by 2
  20. 2026GUI-Perturbed: Domain Randomization Reveals Systematic Brittleness in GUI Grounding Modelscited by 2
  21. 20263D Primitives are a Spatial Language for VLMscited by 2
  22. 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMscited by 2
  23. 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoningcited by 2
  24. 2026SATURN: Symbolic Spatial Reasoning for Multi-Perspective Groundingcited by 2
  25. 2026Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Textcited by 2
  26. 20254D-RGPT: Toward Region-level 4D Understanding via Perceptual Distillationcited by 1
  27. 2026SSR: Pushing the Limit of Spatial Intelligence with Structured Scene Reasoningcited by 1
  28. 20263D-RFT: Reinforcement Fine-Tuning for Video-based 3D Scene Understandingcited by 1
  29. 2026ViewFusion: Structured Spatial Thinking Chains for Multi-View Reasoningcited by 1
  30. 2026What if? Emulative Simulation with World Models for Situated Reasoningcited by 1
  31. 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Modelscited by 1
  32. 2026SpaceMind++: Toward Allocentric Cognitive Maps for Spatially Grounded Video MLLMscited by 1
  33. 2026Grounded 3D-Aware Spatial Vision-Language Modelingcited by 1
  34. 2026OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mappingcited by 1
  35. 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understandingcited by 1
  36. 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoningcited by 1
  37. 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?cited by 1
  38. 2026Grounding Isn't Knowing: Do VLMs Need Object Localization for Spatial Reasoning?cited by 1

50 most cited of 83 All 83 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models
  2. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
  3. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
  4. 2026SpatiaLab: Can Vision-Language Models Perform Spatial Reasoning in the Wild?
  5. 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
  6. 2025Spatial-DISE: A Unified Benchmark for Evaluating Spatial Reasoning in Vision-Language Models
  7. 2024Sparkle: Mastering Basic Spatial Capabilities in Vision Language Models Elicits Generalization to Spatial Reasoning
  8. 2026Spatial-Interactor: Learning Spatial Reasoning through Interaction with the Observable Physical World