mlsanityData to 7 Oct 2026

SSR: Pushing the Limit of Spatial Intelligence with Structured Scene Reasoning

arXiv 2603.00409 ↗First posted 28 Feb 2026cs.CVcited by 1

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

While Multimodal Large Language Models (MLLMs) excel in semantic tasks, they frequently lack the "spatial sense" essential for sophisticated geometric reasoning. Current models typically suffer from exorbitant modality-alignment costs and deficiency in fine-grained structural modeling precision.We introduce SSR, a framework designed for Structured Scene Reasoning that seamlessly integrates 2D and 3D representations via a lightweight alignment mechanism. To minimize training overhead, our framework anchors 3D geometric features to the large language model's pre-aligned 2D visual semantics through cross-modal addition and token interleaving, effectively obviating the necessity for large-scale alignment pre-training. To underpin complex spatial reasoning, we propose a novel scene graph generation pipeline that represents global layouts as a chain of independent local triplets defined by relative coordinates. This is complemented by an incremental generation algorithm, enabling the model to construct "language-model-friendly" structural scaffolds for complex environments. Furthermore, we extend these capabilities to global-scale 3D global grounding task, achieving absolute metric precision across heterogeneous data sources. At a 7B parameter scale, SSR achieves state-of-the-art performance on multiple spatial intelligence benchmarks, notably scoring 73.9 on VSI-Bench. Our approach significantly outperforms much larger models, demonstrating that efficient feature alignment and structured scene reasoning are the cornerstones of authentic spatial intelligence.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 54 references that are in the map. First posted on arXiv 28 Feb 2026.

Builds on

45 of 54 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025Reasoning in Space via Grounding in the World15 Oct
  2. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  3. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  4. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
  5. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  6. 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Models1 May
  7. 2025GeoNav: Empowering MLLMs with dual-scale geospatial reasoning for language-goal aerial navigation13 Apr
  8. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  9. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  10. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  11. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  12. 2022SQA3D: Situated Question Answering in 3D Scenes14 Oct

Other references · 33

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  7. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  8. 2025OpenAI GPT-5 System Cardcited by 910
  9. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  10. 2024Long Context Transfer from Language to Visioncited by 502
  11. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
  12. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
21 more
  1. 2025Seed1.5-VL Technical Reportcited by 367
  2. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 340
  3. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
  4. 2025SmolVLM: Redefining small and efficient multimodal modelscited by 226
  5. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  6. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 160
  7. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
  8. 2023Multi3DRefer: Grounding Text Description to Multiple 3D Objectscited by 142
  9. 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 141
  10. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
  11. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
  12. 2024SG-Nav: Online 3D Scene Graph Prompting for LLM-based Zero-shot Object Navigationcited by 106
  13. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
  14. 2025Visual Spatial Tuningcited by 85
  15. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 75
  16. 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 74
  17. 2025Holistic Evaluation of Multimodal LLMs on Spatial Intelligencecited by 28
  18. 20243DGraphLLM: Combining Semantic Graphs and Large Language Models for 3D Scene Understandingcited by 26
  19. 2025SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligencecited by 22
  20. 2024VLA-3D: A Dataset for 3D Semantic Scene Understanding and Navigationcited by 21
  21. 2024SceneGPT: A Language Model for 3D Scene Understandingcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026GraFT: A Training-Free Framework for Spatial Reasoning in Multimodal Large Language Models via 3D Scene Graphs
  2. 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces
  3. 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing
  4. 2025S2-MLLM: Boosting Spatial Reasoning Capability of MLLMs for 3D Visual Grounding with Structural Guidance
  5. 2026SpaR3D-MoE: Adaptive 3D Spatial Reasoning from Sparse Views Meets Geometry-Inductive Mixture-of-Experts
  6. 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs
  7. 2026Flame3D: Zero-shot Compositional Reasoning of 3D Scenes with Agentic Language Models
  8. 2026SceneAlign: Aligning Multimodal Reasoning to Scene Graphs in Complex Visual Scenes