SpaceVista: All-Scale Visual Spatial Reasoning from mm to km
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
With the current surge in spatial reasoning explorations, researchers have made significant progress in understanding indoor scenes, but still struggle with diverse applications such as robotics and autonomous driving. This paper aims to advance all-scale spatial reasoning across diverse scenarios by tackling two key challenges: 1) the heavy reliance on indoor 3D scans and labor-intensive manual annotations for dataset curation; 2) the absence of effective all-scale scene modeling, which often leads to overfitting to individual scenes. In this paper, we introduce a holistic solution that integrates a structured spatial reasoning knowledge system, scale-aware modeling, and a progressive training paradigm, as the first attempt to broaden the all-scale spatial intelligence of MLLMs to the best of our knowledge. Using a task-specific, specialist-driven automated pipeline, we curate over 38K video scenes across 5 spatial scales to create SpaceVista-1M, a dataset comprising approximately 1M spatial QA pairs spanning 19 diverse task types. While specialist models can inject useful domain knowledge, they are not reliable for evaluation. We then build an all-scale benchmark with precise annotations by manually recording, retrieving, and assembling video-based data. However, naive training with SpaceVista-1M often yields suboptimal results due to the potential knowledge conflict. Accordingly, we introduce SpaceVista-7B, a spatial reasoning model that accepts dense inputs beyond semantics and uses scale as an anchor for scale-aware experts and progressive rewards. Finally, extensive evaluations across 5 benchmarks, including our SpaceVista-Bench, demonstrate competitive performance, showcasing strong generalization across all scales and scenarios. Our dataset, model, and benchmark will be released on https://peiwensun2000.github.io/mm2km .
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 51 of its 95 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
51 of 95 references.
Closest ancestors · 14
Same direction, newest first
- 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture2 Sep
- 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Models4 Aug
- 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models23 Jun
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
- 2025Are Multimodal Large Language Models Ready for Omnidirectional Spatial Reasoning?17 May
- 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning28 Apr
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr
- 2025LEGO-Puzzles: How Good Are MLLMs at Multi-Step Spatial Reasoning?25 Mar
- 2025ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videos16 Mar
2 more
Other references · 37
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025DINOv3cited by 1,414
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
25 more
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 206
- 2024Mixture of LoRA Expertscited by 181
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 115
- 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 109
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Modelscited by 99
- 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuningcited by 93
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 91
- 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 89
- 2024LLaVA-MoLE: Sparse Mixture of LoRA Experts for Mitigating Data Conflicts in Instruction Finetuning MLLMscited by 84
- 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 79
- 2024Fast Feedforward 3D Gaussian Splatting Compressioncited by 52
- 2025Multi-SpatialMLLM: Multi-Frame Spatial Understanding with Multi-Modal Large Language Modelscited by 52
- 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoningcited by 37
- 2025We-Math 2.0: A Versatile MathBook System for Incentivizing Visual Mathematical Reasoningcited by 32
- 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
- 2025Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiencycited by 26
- 2025Small Object Detection: A Comprehensive Survey on Challenges, Techniques and Real-World Applicationscited by 16
- 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMscited by 16
- 2025Metric-Solver: Sliding Anchored Metric Depth Estimation from a Single Imagecited by 6
Built on by
Citing papers per year: 2025: 3; 2026: 16.
19 papers.
Sort:
By area:
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2025Towards Spatial Trace with Reasoning in Vision-Language Models for Roboticscited by 12
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoningcited by 9
- 2026Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learningcited by 9
- 2026Benchmark Everything Everywhere All at Oncecited by 6
- 2026EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMscited by 3
- 20254D-RGPT: Toward Region-level 4D Understanding via Perceptual Distillationcited by 2
- 2026Stepping VLMs onto the Court: Benchmarking Spatial Intelligence in Sportscited by 2
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Taskscited by 2
- 2026Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoningcited by 1
- 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenescited by 1
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoningcited by 1
7 more
- 2026SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Videocited by 1
- 2026GuideMe: Multi-Domain Task Guidance and Intervention in Streaming Videocited by 1
- 2026X-Stream: Exploring MLLMs as Multiplexers for Multi-Stream Understandingcited by 0
- 2026MentalThink: Shaping Thoughts in Mental SVG Worldcited by 0
- 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Modelscited by 0
- 2026SpatialOPSD: Self-Distilling Spatial Intelligence from Verified Coding Agent Tracescited by 0
- 2026Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Modelscited by 0
- 2026Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models13 Oct 2026
- 2026SpatialOPSD: Self-Distilling Spatial Intelligence from Verified Coding Agent Traces8 Oct 2026
- 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Models30 Sep 2026
- 2026MentalThink: Shaping Thoughts in Mental SVG World3 Jul 2026
- 2026GuideMe: Multi-Domain Task Guidance and Intervention in Streaming Video3 Jul 2026
- 2026SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video2 Jul 2026
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning10 Jun 2026
- 2026Benchmark Everything Everywhere All at Once4 Jun 2026
- 2026X-Stream: Exploring MLLMs as Multiplexers for Multi-Stream Understanding1 Jun 2026
- 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes29 May 2026
- 2026Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning28 May 2026
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks9 Apr 2026
7 more
- 2026Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learning8 Apr 2026
- 2026EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMs1 Apr 2026
- 2026Stepping VLMs onto the Court: Benchmarking Spatial Intelligence in Sports10 Mar 2026
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning30 Jan 2026
- 20254D-RGPT: Toward Region-level 4D Understanding via Perceptual Distillation18 Dec 2025
- 2025Towards Spatial Trace with Reasoning in Vision-Language Models for Robotics15 Dec 2025
- 2025OneThinker: All-in-one Reasoning Model for Image and Video2 Dec 2025
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2025Towards Spatial Trace with Reasoning in Vision-Language Models for Roboticscited by 12
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoningcited by 9
- 2026Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learningcited by 9
- 2026EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMscited by 3
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Taskscited by 2
- 2026Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoningcited by 1
- 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenescited by 1
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoningcited by 1
- 2026SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Videocited by 1
- 2026MentalThink: Shaping Thoughts in Mental SVG Worldcited by 0
- 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Modelscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models13 Oct 2026
- 2026SpatialOPSD: Self-Distilling Spatial Intelligence from Verified Coding Agent Traces8 Oct 2026
- 2026SpatialCORE: Confidence-Aware Grounded Spatial Reasoning in Large Vision--Language Models30 Sep 2026
- 2026MentalThink: Shaping Thoughts in Mental SVG World3 Jul 2026
- 2026SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video2 Jul 2026
- 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning10 Jun 2026
- 2026SpatialAct: Probing Spatial Reasoning-to-Action Capabilities of VLM Agents in 3D Scenes29 May 2026
- 2026Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning28 May 2026
- 2026OpenVLThinkerV2: A Generalist Multimodal Reasoning Model for Multi-domain Visual Tasks9 Apr 2026
- 2026Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learning8 Apr 2026
- 2026EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMs1 Apr 2026
- 2026CamReasoner: Reinforcing Camera Movement Understanding via Structured Spatial Reasoning30 Jan 2026
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025SpatialMosaic: A Multiview VLM Dataset for Partial Visibility
- 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models
- 2026SpatialForge: Bootstrapping 3D-Aware Spatial Reasoning from Open-World 2D Images
- 2025From Indoor to Open World: Revealing the Spatial Reasoning Gap in MLLMs
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models
- 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces