mlsanityData to 7 Oct 2026

SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoning

arXiv 2609.33616 ↗First posted 27 Sep 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Vision-language models (VLMs) can benefit from geometric priors for multi-view spatial reasoning, yet answer-only training does not directly supervise the intermediate geometric estimates and their use in deriving quantitative spatial answers. We hypothesize that spatial chain-of-thought (CoT) supervision becomes more effective when the VLM first jointly learns complementary local geometry and global scene context through multi-view reconstruction. We introduce SpatialSpeak, a two-stage framework that connects QA-native reconstruction pretraining with spatial CoT learning. In Stage I, QA-Native Reconstruction Pretraining (QA-RP) combines marked-point 3D queries for fine-grained local geometry with object-center queries for global scene context across views. Both tasks are formulated as text-based question answering, allowing geometric estimation and subsequent reasoning to share the same autoregressive output interface. In Stage II, spatial CoT with Visual Compensation (CoT-VC) trains the model to express question-relevant geometric estimates and use them to derive answers, with reliability assessment and visual compensation supporting answer refinement when needed. On ReVSI, QA-RP increases the gain from CoT-VC from 2.6 to 6.9 points, and ablations show that both local and global reconstruction supervision are beneficial. SpatialSpeak achieves state-of-the-art results on ReVSI, VSI-Bench, and SPAR-Bench, with a ReVSI score of 62.8 that exceeds the strongest compared baseline by 8.7 points.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 60 of its 64 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

60 of 64 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning27 Apr
  2. 2026SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning28 Mar
  3. 2026GAP-MLLM: Geometry-Aligned Pre-training for Activating 3D Spatial Perception in Multimodal Large Language Models17 Mar
  4. 2026Thinking with Geometry: Active Geometry Integration for Spatial Reasoning5 Feb
  5. 2026Map2Thought: Explicit 3D Spatial Reasoning via Metric Cognitive Maps16 Jan
  6. 2025N3D-VLM: Native 3D Grounding Enables Accurate Spatial Reasoning in Vision-Language Models18 Dec
  7. 2025G2VLM: Geometry Grounded Vision Language Model with Unified 3D Reconstruction and Spatial Reasoning26 Nov
  8. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  9. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  10. 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understanding2 Jun
  11. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  12. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec

Other references · 48

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  7. 2025Qwen3-VL Technical Reportcited by 2,534
  8. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  9. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  11. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  12. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
36 more
  1. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  2. 2025OpenAI GPT-5 System Cardcited by 910
  3. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  4. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  5. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  6. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  7. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  8. 2024Long Context Transfer from Language to Visioncited by 502
  9. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
  10. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
  11. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  12. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  13. 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 204
  14. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
  15. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 131
  16. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
  17. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
  18. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
  19. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
  20. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
  21. 2020Visibility-aware Multi-view Stereo Networkcited by 97
  22. 2025Visual Spatial Tuningcited by 85
  23. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 75
  24. 2024Large Spatial Model: End-to-end Unposed Images to Semantic 3Dcited by 73
  25. 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 67
  26. 2023CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detectioncited by 51
  27. 2025DepthLM: Metric Depth From Vision Language Modelscited by 29
  28. 2025Omni-View: Unlocking How Generation Facilitates Understanding in Unified 3D Model based on Multiview imagescited by 15
  29. 2025FlashVGGT: Efficient and Scalable Visual Geometry Transformers with Compressed Descriptor Attentioncited by 15
  30. 2025UniUGG: Unified 3D Understanding and Generation via Geometric-Semantic Encodingcited by 9
  31. 2025Does Your 3D Encoder Really Work? When Pretrain-SFT from 2D VLMs Meets 3D VLMscited by 8
  32. 2025One4D: Unified 4D Generation and Reconstruction via Decoupled LoRA Controlcited by 8
  33. 2025Empowering Sparse-Input Neural Radiance Fields with Dual-Level Semantic Guidance from Dense Novel Viewscited by 6
  34. 2026VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detectioncited by 6
  35. 2025Progressive Gaussian Transformer with Anisotropy-aware Sampling for Open Vocabulary Occupancy Predictioncited by 4
  36. 2026PartLLM: A Unified Multimodal Foundation for 3D Part Segmentationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SpatialChain: A Benchmark for Auditing Spatial Reasoning Faithfulness in VLMs
  2. 2026GeoLatent: Geometry-Guided Latent Structuring with Routed Optimization for 3D Reasoning
  3. 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning
  4. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities
  5. 2026Multi-View Relational Distillation for Spatial Reasoning with Vision-Language Models
  6. 2026ViewFusion: Structured Spatial Thinking Chains for Multi-View Reasoning
  7. 2026Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning
  8. 2026SpatiaLQA: A Benchmark for Evaluating Spatial Logical Reasoning in Vision-Language Models