OpenSpatial: A Principled Data Engine for Empowering Spatial Intelligence
Not on the map. Why?
Abstract (arXiv)
Spatial understanding is a fundamental cornerstone of human-level intelligence. Nonetheless, current research predominantly focuses on domain-specific data production, leaving a critical void: the absence of a principled, open-source engine capable of fully unleashing the potential of high-quality spatial data. To bridge this gap, we elucidate the design principles of a robust data generation system and introduce OpenSpatial -- an open-source data engine engineered for high quality, extensive scalability, broad task diversity, and optimized efficiency. OpenSpatial adopts 3D bounding boxes as the fundamental primitive to construct a comprehensive data hierarchy across five foundational tasks: Spatial Measurement (SM), Spatial Relationship (SR), Camera Perception (CP), Multi-view Consistency (MC), and Scene-Aware Reasoning (SAR). Leveraging this scalable infrastructure, we curate OpenSpatial-3M, a large-scale dataset comprising 3 million high-fidelity samples. Extensive evaluations demonstrate that versatile models trained on our dataset achieve state-of-the-art performance across a wide spectrum of spatial reasoning benchmarks. Notably, the best-performing model exhibits a substantial average improvement of 19 percent, relatively. Furthermore, we provide a systematic analysis of how data attributes influence spatial perception. By open-sourcing both the engine and the 3M-scale dataset, we provide a robust foundation to accelerate future research in spatial intelligence.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 53 of its 60 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
53 of 60 references.
References · 53
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
38 more
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 679
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2025Kimi-VL Technical Reportcited by 381
- 2025Seed1.5-VL Technical Reportcited by 367
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoningcited by 152
- 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 146
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 133
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 130
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
- 2025Visual Spatial Tuningcited by 85
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Modelscited by 83
- 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 75
- 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 72
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 58
- 2025Multi-SpatialMLLM: Multi-Frame Spatial Understanding with Multi-Modal Large Language Modelscited by 52
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 47
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMscited by 2
- 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoningcited by 0
- 2026Advantage-Guided Gate: Reshaping Open-Ended Reasoning for Vision-Based Spatial Intelligencecited by 0
- 2026SpatialOPSD: Self-Distilling Spatial Intelligence from Verified Coding Agent Tracescited by 0
- 2026SpatialOPSD: Self-Distilling Spatial Intelligence from Verified Coding Agent Traces8 Oct 2026
- 2026Advantage-Guided Gate: Reshaping Open-Ended Reasoning for Vision-Based Spatial Intelligence8 Aug 2026
- 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoning5 Jun 2026
- 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMs25 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models
- 2026SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models
- 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces
- 2025SpaceVista: All-Scale Visual Spatial Reasoning from mm to km
- 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligence
- 2025A Survey of Large Language Model-Powered Spatial Intelligence Across Scales: Advances in Embodied Agents, Smart Cities, and Earth Science
- 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Models
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics