Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Spatial intelligence is crucial for vision--language models (VLMs), yet many scene-centric benchmarks evaluate unconstrained environments where a single image may admit multiple plausible 3D interpretations. We introduce SSI-Bench, a VQA benchmark for Structure-Centric Spatial Reasoning (SCSR) in constraint-governed spaces. Built from complex real-world 3D structures, it uses structural constraints from geometry, topology, and physical feasibility to make component relations more determinate from visual evidence. The benchmark contains 1,000 ranking questions spanning geometric and topological reasoning, where correct ordering requires resolving all candidate-wise 3D relations, imposing stronger demands on spatial understanding. It is created through a fully human-centered pipeline with over 400 researcher-hours of image curation, component annotation, and question design. Evaluating 31 VLMs reveals a large gap to humans: the best open-source model achieves 22.2% accuracy and the strongest closed-source model reaches 33.6%, while humans score 91.6%. Further results show that chain-of-thought reasoning brings only marginal gains, and error analysis reveals fundamental limitations in current models' spatial understanding within constraint-governed spaces. Project page: https://ssi-bench.github.io.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 15 of its 52 references that are in the map. First posted on arXiv 8 Feb 2026.
Builds on
15 of 52 references.
Closest ancestors · 3
Same direction, newest first
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
Other references · 12
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
- 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 74
- 2025Multi-SpatialMLLM: Multi-Frame Spatial Understanding with Multi-Modal Large Language Modelscited by 52
- 2025A Survey of State of the Art Large Vision Language Models: Alignment, Benchmark, Evaluations and Challengescited by 46
- 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 34
- 2025OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understandingcited by 24
- 2025EgoExoBench: A Benchmark for First- and Third-person View Video Understanding in MLLMscited by 22
- 2025DSI-Bench: A Benchmark for Dynamic Spatial Intelligencecited by 20
- 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMscited by 16
- 2025CVBench: Benchmarking Cross-Video Synergies for Complex Multimodal Reasoningcited by 14
- 2025ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric Interactioncited by 14
- 2025InteractComp: Evaluating Search Agents With Ambiguous Queriescited by 12
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
- 2025Ascending the Infinite Ladder: Benchmarking Spatial Deformation Reasoning in Vision-Language Models
- 2025Reasoning Path and Latent State Analysis for Multi-view Visual Spatial Reasoning: A Cognitive Science Perspective
- 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
- 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
- 20263ViewSense: Spatial and Mental Perspective Reasoning from Orthographic Views in Vision-Language Models
- 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
- 2025Spatial Reasoning in Foundation Models: Benchmarking Object-Centric Spatial Understanding