mlsanityData to 7 Oct 2026

Exploring Spatial Intelligence from a Generative Perspective

arXiv 2604.20570 ↗First posted 22 Apr 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Spatial intelligence is essential for multimodal large language models, yet current benchmarks largely assess it only from an understanding perspective. We ask whether modern generative or unified multimodal models also possess generative spatial intelligence (GSI), the ability to respect and manipulate 3D spatial constraints during image generation, and whether such capability can be measured or improved. We introduce GSI-Bench, the first benchmark designed to quantify GSI through spatially grounded image editing. It consists of two complementary components: GSI-Real, a high-quality real-world dataset built via a 3D-prior-guided generation and filtering pipeline, and GSI-Syn, a large-scale synthetic benchmark with controllable spatial operations and fully automated labeling. Together with a unified evaluation protocol, GSI-Bench enables scalable, model-agnostic assessment of spatial compliance and editing fidelity. Experiments show that fine-tuning unified multimodal models on GSI-Syn yields substantial gains on both synthetic and real tasks and, strikingly, also improves downstream spatial understanding. This provides the first clear evidence that generative training can tangibly strengthen spatial reasoning, establishing a new pathway for advancing spatial intelligence in multimodal models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 41 of its 47 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

41 of 47 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025MindCube: Spatial Mental Modeling from Limited Views26 Jun
  2. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
  3. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence29 May
  4. 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concrete28 Feb
  5. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  6. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Models10 Dec
  7. 2024REVISION: Rendering Tools Enable Spatial Fidelity in Vision-Language Models5 Aug
  8. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics15 Jun
  9. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 32

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  8. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  9. 2018World Modelscited by 1,444
  10. 2025Qwen-Image Technical Reportcited by 973
  11. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  12. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
20 more
  1. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  2. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  3. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  4. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  5. 2023Learning Interactive Real-World Simulatorscited by 440
  6. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  7. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  8. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  9. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 196
  10. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
  11. 2023Towards Learning a Generalist Model for Embodied Navigationcited by 135
  12. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
  13. 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 74
  14. 2025Embodied Navigation Foundation Modelcited by 65
  15. 2025Detect Anything 3D in the Wildcited by 32
  16. 2025InternScenes: A Large-scale Simulatable Indoor Scene Dataset with Realistic Layoutscited by 18
  17. 2025MesaTask: Towards Task-Driven Tabletop Scene Generation via 3D Spatial Reasoningcited by 15
  18. 2025GenSpace: Benchmarking Spatially-Aware Image Generationcited by 9
  19. 2025RoboTron-Nav: A Unified Framework for Embodied Navigation Integrating Perception, Planning, and Predictioncited by 8
  20. 2025NoTVLA: Semantics-Preserving Robot Adaptation via Narrative Action Interfacescited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
  2. 2026Everything in Its Place: Benchmarking Spatial Intelligence of Text-to-Image Models
  3. 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning
  4. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
  5. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence
  6. 2026Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligence
  7. 2026JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generation
  8. 2026Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generation