Thinking with Geometry: Active Geometry Integration for Spatial Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Recent progress in spatial reasoning with Multimodal Large Language Models (MLLMs) increasingly leverages geometric priors from 3D encoders. However, most existing integration strategies remain passive: geometry is exposed as a global stream and fused in an indiscriminate manner, which often induces semantic-geometry misalignment and redundant signals. We propose GeoThinker, a framework that shifts the paradigm from passive fusion to active perception. Instead of feature mixing, GeoThinker enables the model to selectively retrieve geometric evidence conditioned on its internal reasoning demands. GeoThinker achieves this through Spatial-Grounded Fusion applied at carefully selected VLM layers, where semantic visual priors selectively query and integrate task-relevant geometry via frame-strict cross-attention, further calibrated by Importance Gating that biases per-frame attention toward task-relevant structures. Comprehensive evaluation results show that GeoThinker sets a new state-of-the-art in spatial intelligence, achieving a peak score of 72.6 on the VSI-Bench. Furthermore, GeoThinker demonstrates robust generalization and significantly improved spatial perception across complex downstream scenarios, including embodied referring and autonomous driving. Our results indicate that the ability to actively integrate spatial structures is essential for next-generation spatial intelligence. Code can be found at https://github.com/Li-Hao-yuan/GeoThinker.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 62 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
41 of 62 references.
Closest ancestors · 9
Same direction, newest first
- 2025Learning to Reason in 4D: Dynamic Spatial Understanding for Vision Language Models23 Dec
- 2025G2VLM: Geometry Grounded Vision Language Model with Unified 3D Reconstruction and Spatial Reasoning26 Nov
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
- 2025Reasoning in Space via Grounding in the World15 Oct
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
Other references · 32
- 2023GPT-4 Technical Reportcited by 18,132
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
- 2025Seed1.5-VL Technical Reportcited by 367
20 more
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
- 2025Visual Spatial Tuningcited by 85
- 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 75
- 2025Ross3D: Reconstructive Visual Instruction Tuning with 3D-Awarenesscited by 61
- 2025A0: An Affordance-Aware Hierarchical Model for General Robotic Manipulationcited by 44
- 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 34
- 2025Holistic Evaluation of Multimodal LLMs on Spatial Intelligencecited by 28
- 2025SITE: towards Spatial Intelligence Thorough Evaluationcited by 26
- 2025Benchmark Designers Should "Train on the Test Set" to Expose Exploitable Non-Visual Shortcutscited by 26
- 2024PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videoscited by 21
- 2024PPLLaVA: Varied Video Sequence Understanding With Prompt Guidancecited by 20
- 2025Does Your 3D Encoder Really Work? When Pretrain-SFT from 2D VLMs Meets 3D VLMscited by 8
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026From Pixels to Words -- Towards Native One-Vision Models at Scalecited by 6
- 2026Cambrian-P: Pose-Grounded Video Understandingcited by 2
- 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMscited by 2
- 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoningcited by 1
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?cited by 1
- 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoningcited by 0
- 2026GeoWeaver: Grounding Visual Tokens with Geometric Evidence before Scene Reasoningcited by 0
- 2026Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoningcited by 0
- 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Modelscited by 0
- 2026Beyond Single Expert: Harmonizing Diverse Visual Priors in MLLMs for Spatial Understandingcited by 0
- 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Modelscited by 0
- 2026SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoningcited by 0
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving7 Oct 2026
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning28 Sep 2026
- 2026SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoning27 Sep 2026
- 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models10 Aug 2026
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?23 Jul 2026
- 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoning20 Jul 2026
- 2026Beyond Single Expert: Harmonizing Diverse Visual Priors in MLLMs for Spatial Understanding16 Jul 2026
- 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models4 Jun 2026
- 2026From Pixels to Words -- Towards Native One-Vision Models at Scale27 May 2026
- 2026Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning26 May 2026
- 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMs25 May 2026
- 2026Cambrian-P: Pose-Grounded Video Understanding21 May 2026
- 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMscited by 2
- 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoningcited by 1
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?cited by 1
- 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoningcited by 0
- 2026GeoWeaver: Grounding Visual Tokens with Geometric Evidence before Scene Reasoningcited by 0
- 2026Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoningcited by 0
- 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Modelscited by 0
- 2026SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoningcited by 0
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoningcited by 0
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Drivingcited by 0
- 2026Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving7 Oct 2026
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning28 Sep 2026
- 2026SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoning27 Sep 2026
- 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models10 Aug 2026
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?23 Jul 2026
- 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoning20 Jul 2026
- 2026Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning26 May 2026
- 2026ProSR: Process-Shaped Spatial Reasoning for Reliable Chain-of-Thought in VLMs25 May 2026
- 2026GeoWeaver: Grounding Visual Tokens with Geometric Evidence before Scene Reasoning21 May 2026
- 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning19 Apr 2026
- 2026From Pixels to Words -- Towards Native One-Vision Models at Scalecited by 6
- 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Modelscited by 0
- 2026Beyond Single Expert: Harmonizing Diverse Visual Priors in MLLMs for Spatial Understandingcited by 0
- 2026Beyond Single Expert: Harmonizing Diverse Visual Priors in MLLMs for Spatial Understanding16 Jul 2026
- 2026Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models4 Jun 2026
- 2026From Pixels to Words -- Towards Native One-Vision Models at Scale27 May 2026
- 2026Cambrian-P: Pose-Grounded Video Understandingcited by 2
- 2026Cambrian-P: Pose-Grounded Video Understanding21 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026GeoSense: Internalizing Geometric Necessity Perception for Multimodal Reasoning
- 2026Make Geometry Matter for Spatial Reasoning
- 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Models
- 2026Disentangling 3D Modeling from Spatial Reasoning
- 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understanding
- 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
- 2026SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning
- 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models