mlsanityData to 7 Oct 2026

OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligence

arXiv 2604.07296 ↗First posted 8 Apr 2026cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Spatial understanding is a fundamental cornerstone of human-level intelligence. Nonetheless, current research predominantly focuses on domain-specific data production, leaving a critical void: the absence of a principled, open-source engine capable of fully unleashing the potential of high-quality spatial data. To bridge this gap, we elucidate the design principles of a robust data generation system and introduce OpenSpatial -- an open-source data engine engineered for high quality, extensive scalability, broad task diversity, and optimized efficiency. OpenSpatial adopts 3D bounding boxes as the fundamental primitive to construct a comprehensive data hierarchy across five foundational tasks: Spatial Measurement (SM), Spatial Relationship (SR), Camera Perception (CP), Multi-view Consistency (MC), and Scene-Aware Reasoning (SAR). Leveraging this scalable infrastructure, we curate OpenSpatial-3M, a large-scale dataset comprising 3 million high-fidelity samples. Extensive evaluations demonstrate that versatile models trained on our dataset achieve state-of-the-art performance across a wide spectrum of spatial reasoning benchmarks. Notably, the best-performing model exhibits a substantial average improvement of 19 percent, relatively. Furthermore, we provide a systematic analysis of how data attributes influence spatial perception. By open-sourcing both the engine and the 3M-scale dataset, we provide a robust foundation to accelerate future research in spatial intelligence.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 53 of its 60 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

53 of 60 references.

References · 53

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Segment Anythingcited by 8,158
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  7. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  8. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  9. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2025Qwen3-VL Technical Reportcited by 2,534
  12. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
38 more
  1. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  2. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  4. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  6. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  7. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  8. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  9. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  10. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  11. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
  12. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  13. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  14. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  15. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  16. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  17. 2025Kimi K2: Open Agentic Intelligencecited by 523
  18. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
  19. 2025Kimi-VL Technical Reportcited by 381
  20. 2025Seed1.5-VL Technical Reportcited by 367
  21. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
  22. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
  23. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
  24. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  25. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
  26. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
  27. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 152
  28. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
  29. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 133
  30. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 130
  31. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
  32. 2025Visual Spatial Tuningcited by 85
  33. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Modelscited by 83
  34. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 75
  35. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 72
  36. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 58
  37. 2025Multi-SpatialMLLM: Multi-Frame Spatial Understanding with Multi-Modal Large Language Modelscited by 52
  38. 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 47

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models
  2. 2026SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models
  3. 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces
  4. 2025SpaceVista: All-Scale Visual Spatial Reasoning from mm to km
  5. 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligence
  6. 2025A Survey of Large Language Model-Powered Spatial Intelligence Across Scales: Advances in Embodied Agents, Smart Cities, and Earth Science
  7. 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Models
  8. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics