Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Spatial understanding is fundamental to embodied intelligence, underpinning applications such as robotic manipulation, embodied navigation, and autonomous driving. Although recent vision-language models (VLMs) have achieved impressive performance on spatial reasoning benchmarks, state-of-the-art approaches typically rely on additional spatial encoders or architectural modifications during inference, increasing computational cost. We introduce Space Tokens, a lightweight, architecture-agnostic framework that equips VLMs with explicit continuous spatial representations without requiring additional inference-time modules. By distilling scene-level 3D geometry and object-centric spatial attributes into continuous latent tokens, our method enables these modalities to be directly incorporated into a chain-of-thought reasoning process, thereby improving the VLM's spatial reasoning capabilities. At the same time, the learned representations can be explicitly decoded to verify that they encode meaningful geometric information, while the unified token interface remains extensible to additional modalities. Experiments on VSI-Bench improve Qwen3-VL-8B by 4.3% and SenseNova-SI-1.3 by 1.3%, while achieving state-of-the-art performance on object size (79.2%) and room size estimation (75.7%). These results demonstrate that continuous spatial tokens provide an effective, interpretable, and computationally efficient mechanism for integrating geometric reasoning into large vision-language models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 38 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
26 of 38 references.
Closest ancestors · 8
Same direction, newest first
- 2026Thinking with Spatial Code for Physical-World Video Reasoning5 Mar
- 2026SSR: Pushing the Limit of Spatial Intelligence with Structured Scene Reasoning28 Feb
- 2026Thinking with Geometry: Active Geometry Integration for Spatial Reasoning5 Feb
- 2025N3D-VLM: Native 3D Grounding Enables Accurate Spatial Reasoning in Vision-Language Models18 Dec
- 2025SpaceMind: Camera-Guided Modality Fusion for Spatial Reasoning in Vision-Language Models28 Nov
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
Other references · 18
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Gemma 3 Technical Reportcited by 1,824
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
6 more
- 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokenscited by 71
- 2025Holistic Evaluation of Multimodal LLMs on Spatial Intelligencecited by 29
- 2025Visuospatial Cognitive Assistantcited by 11
- 2025LocateAnything3D: Vision-Language 3D Detection with Chain-of-Sightcited by 8
- 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Modelscited by 7
- 2026Ablate-to-Validate: Are Vision-Language Models Really Using Continuous Thought Tokens?cited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models
- 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
- 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces
- 2026The Spatial Blindspot of Vision-Language Models
- 2026ESPIRE: A Diagnostic Benchmark for Embodied Spatial Reasoning of Vision-Language Models
- 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning
- 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
- 2025Vision-Language Memory for Spatial Reasoning