mlsanityData to 14 Oct 2026

SpatialTree: How Spatial Abilities Branch Out in MLLMs

arXiv 2512.20617 ↗First posted 23 Dec 2025cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

Cognitive science suggests that spatial ability develops progressively-from perception to reasoning and interaction. Yet in multimodal LLMs (MLLMs), this hierarchy remains poorly understood, as most studies focus on a narrow set of tasks. We introduce SpatialTree, a cognitive-science-inspired hierarchy that organizes spatial abilities into four levels: low-level perception (L1), mental mapping (L2), simulation (L3), and agentic competence (L4). Based on this taxonomy, we construct the first capability-centric hierarchical benchmark, thoroughly evaluating mainstream MLLMs across 27 sub-abilities. The evaluation results reveal a clear structure: L1 skills are largely orthogonal, whereas higher-level skills are strongly correlated, indicating increasing interdependency. Through targeted supervised fine-tuning, we uncover a surprising transfer dynamic-negative transfer within L1, but strong cross-level transfer from low- to high-level abilities with notable synergy. Finally, we explore how to improve the entire hierarchy. We find that naive RL that encourages extensive "thinking" is unreliable: it helps complex reasoning but hurts intuitive perception. We propose a simple auto-think strategy that suppresses unnecessary deliberation, enabling RL to consistently improve performance across all levels. By building SpatialTree, we provide a proof-of-concept framework for understanding and systematically scaling spatial abilities in MLLMs.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 50 of its 64 references that are in the map. First posted on arXiv 23 Dec 2025.

Builds on

50 of 64 references.

References · 50

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  7. 2025Qwen2.5-VL Technical Reportcited by 5,587
  8. 2024GPT-4o System Cardcited by 4,588
  9. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  10. 2023Qwen Technical Reportcited by 3,344
  11. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  12. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
38 more
  1. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  2. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  3. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  4. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  5. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
  6. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  7. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  8. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  9. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  10. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  11. 2025Kimi-VL Technical Reportcited by 388
  12. 2025Seed1.5-VL Technical Reportcited by 373
  13. 2023PointLLM: Empowering Large Language Models to Understand Point Cloudscited by 333
  14. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 221
  15. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
  16. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 183
  17. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
  18. 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
  19. 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 146
  20. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
  21. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 114
  22. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Modelscited by 113
  23. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
  24. 2025Visual Spatial Tuningcited by 89
  25. 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 87
  26. 2022Learning Affordance Grounding from Exocentric Imagescited by 82
  27. 2025Yume: An Interactive World Generation Modelcited by 81
  28. 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 65
  29. 2025Towards Understanding Camera Motions in Any Videocited by 64
  30. 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenescited by 63
  31. 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 52
  32. 2025Multi-SpatialMLLM: Multi-Frame Spatial Understanding with Multi-Modal Large Language Modelscited by 52
  33. 2024Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Modelscited by 45
  34. 2025Trace Anything: Representing Any Video in 4D via Trajectory Fieldscited by 33
  35. 2025SITE: towards Spatial Intelligence Thorough Evaluationcited by 29
  36. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methodscited by 23
  37. 2025IR3D-Bench: Evaluating Vision-Language Model Scene Understanding as Agentic Inverse Renderingcited by 19
  38. 2025InfinityHuman: Towards Long-Term Audio-Driven Humancited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 202511Plus-Bench: Demystifying Multimodal LLM Spatial Reasoning with Cognitive-Inspired Analysis
  2. 2025Defining and Evaluating Visual Language Models' Basic Spatial Abilities: A Perspective from Psychometrics
  3. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
  4. 2026From Where Things Are to What They Are For: Benchmarking Spatial-Functional Intelligence in Multimodal LLMs
  5. 2026From Human Cognition to Neural Activations: Probing the Computational Primitives of Spatial Reasoning in LLMs
  6. 2026Chain-of-Thought Degrades Visual Spatial Reasoning Capabilities of Multimodal LLMs
  7. 2024Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models
  8. 2025Spatial4D-Bench: A Versatile 4D Spatial Intelligence Benchmark