mlsanityData to 14 Oct 2026

Think3D: Thinking with Space for Spatial Reasoning

arXiv 2601.13029 ↗First posted 19 Jan 2026cs.CVcited by 24

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

While Vision-Language Models (VLMs) excel at 2D visual understanding, they remain constrained by 2D-centric paradigm that severely limits genuine 3D spatial reasoning. To bridge this gap, we introduce Think3D, a novel framework that equips VLM agents with interactive, 3D chain-of-thought reasoning capabilities. By integrating a suite of 3D manipulation tools, Think3D transforms perception into active spatial exploration, mirroring human geometric reasoning. Think3D consistently improves proprietary models, including GPT-4.1 and Gemini 2.5 Pro, across BLINK Multi-view, MindCube-1K, and VSI-Bench-Tiny. We further propose Think3D-RL to teach smaller open-weight models how to manipulate 3D space effectively. Using only final-answer rewards, without process supervision or handcrafted exploration trajectories, Think3D-RL enables Qwen3-VL-4B to autonomously learn effective 3D exploration strategies. After training, the model exhibits tool-use patterns similar to those of stronger proprietary models, while shifting the effect of 3D tool use on MindCube-1K from a performance drop to a substantial improvement. These results show that active exploration in 3D space provides an effective and general paradigm for improving spatial reasoning in multimodal agents. Code, models, and data are available at https://github.com/zhangzaibin/spagent.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 81 of its 98 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

81 of 98 references.

Closest ancestors · 18

Same direction, newest first

  1. 2026CoV: Chain-of-View Prompting for Spatial Reasoning8 Jan
  2. 2025Towards Spatial Trace with Reasoning in Vision-Language Models for Robotics15 Dec
  3. 2025Geometrically-Constrained Agent for Spatial Reasoning27 Nov
  4. 2025Video Spatial Reasoning with Object-Centric 3D Rollout17 Nov
  5. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  6. 2025TIGeR: Tool-Integrated Geometric Reasoning in Vision-Language Models for Robotics8 Oct
  7. 2025How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective23 Sep
  8. 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning16 Jul
  9. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  10. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
  11. 2025SpatialPrompting: Keyframe-driven Zero-Shot Spatial Reasoning with Off-the-Shelf Multimodal Large Language Models8 May
  12. 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation24 Apr
6 more
  1. 2025Visual Agentic AI for Spatial Reasoning with a Dynamic API10 Feb
  2. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  3. 2024Coarse Correspondences Boost Spatial-Temporal Reasoning in Multimodal Language Model1 Aug
  4. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  5. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  6. 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models26 May

Other references · 63

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024GPT-4o System Cardcited by 4,588
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  9. 2025Qwen3-VL Technical Reportcited by 2,793
  10. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  11. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  12. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
38 more
  1. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  2. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  3. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  4. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
  5. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 603
  6. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  7. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  8. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 517
  9. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  10. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
  11. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  12. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
  13. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoningcited by 280
  14. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  15. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
  16. 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 193
  17. 2025Agentic Reinforced Policy Optimizationcited by 172
  18. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  19. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
  20. 2025Seed1.5-Thinking: Advancing Superb Reasoning Models with Reinforcement Learningcited by 161
  21. 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 160
  22. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
  23. 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 135
  24. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  25. 2025GRIT: Teaching MLLMs to Think with Imagescited by 125
  26. 2025Perception-Aware Policy Optimization for Multimodal Reasoningcited by 99
  27. 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 98
  28. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
  29. 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Usecited by 90
  30. 2025RoboBrain 2.0 Technical Reportcited by 89
  31. 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 87
  32. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
  33. 2025PyVision: Agentic Vision with Dynamic Toolingcited by 79
  34. 2023GPT-4V(ision) for Robotics: Multimodal Task Planning from Human Demonstrationcited by 77
  35. 2024MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learningcited by 69
  36. 2025LVAgent: Long Video Understanding by Multi-Round Dynamical Collaboration of MLLM Agentscited by 58
  37. 2024VCA: Video Curious Agent for Long Video Understandingcited by 56
  38. 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLMcited by 46

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 24.

24 papers.

Sort:

By area:

  1. 2026SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoningcited by 17
  2. 2026Act Wisely: Cultivating Meta-Cognitive Tool Use in Agentic Multimodal Modelscited by 14
  3. 2026S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligencecited by 11
  4. 2026HomeGuard: VLM-based Embodied Safeguard for Identifying Contextual Risk in Household Taskcited by 5
  5. 2026See, Remember, Explore: A Benchmark and Baselines for Streaming Spatial Reasoningcited by 4
  6. 2026Dense Reward for Multi-View 3D Reasoning with Global Maps and Local Viewscited by 3
  7. 2026How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoningcited by 2
  8. 2026AlloSpatial: Agentic Harness Framework for Spatial Reasoning in Foundation Modelscited by 2
  9. 2026OmniView-Space: Reinforcing Spatial Reasoning via Multi-Perspective Spatial Mappingcited by 2
  10. 2026World2Mind: Cognition Toolkit for Allocentric Spatial Reasoning in Foundation Modelscited by 1
  11. 2026Thinking with Novel Views: A Systematic Analysis of Generative-Augmented Spatial Intelligencecited by 1
  12. 2026Towards Camera-Robust 3D Localization: Equation-Anchored Tool-Use for MLLMscited by 1
12 more
  1. 2026Skill-3D: Evolving Scene-Aware Skills for Agentic 3D Spatial Reasoningcited by 1
  2. 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoningcited by 1
  3. 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoningcited by 1
  4. 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?cited by 1
  5. 2026Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoningcited by 0
  6. 2026Perceive, Interact, Reason: Building Tool-Augmented Visual Agents for Spatial Reasoningcited by 0
  7. 2026R3D: Quantitative 3D Spatial Reasoning for Egocentric Wearablescited by 0
  8. 2026SpatialOPSD: Self-Distilling Spatial Intelligence from Verified Coding Agent Tracescited by 0
  9. 2026Seek-and-View Reasoning for Multi-View Spatial Understandingcited by 0
  10. 2026Distilling Routed 3D Privilege for Spatial Reasoning in Vision-Language Modelscited by 0
  11. 2026SpatialASM: Internalizing Active Mentalization for Spatial Reasoningcited by 0
  12. 2026ReTAC: Residual Test-Time Agentic Computation for Video Spatial Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 20263DThinkVLA: Endowing Vision-Language-Action Models with Latent 3D Priors via 3D-Thinking-Guided Co-training
  2. 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
  3. 2025Abstract 3D Perception for Spatial Intelligence in Vision-Language Models
  4. 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
  5. 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoning
  6. 2025Run, Ruminate, and Regulate: A Dual-process Thinking System for Vision-and-Language Navigation
  7. 2026Disentangling 3D Modeling from Spatial Reasoning
  8. 20263ViewSense: Spatial and Mental Perspective Reasoning from Orthographic Views in Vision-Language Models