Beyond Flatlands: Unlocking Spatial Intelligence by Decoupling 3D Reasoning from Numerical Regression
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Existing Vision Language Models (VLMs) architecturally rooted in "flatland" perception, fundamentally struggle to comprehend real-world 3D spatial intelligence. This failure stems from a dual-bottleneck: input-stage conflict between computationally exorbitant geometric-aware encoders and superficial 2D-only features, and output-stage misalignment where discrete tokenizers are structurally incapable of producing precise, continuous numerical values. To break this impasse, we introduce GEODE (Geometric-Output and Decoupled-Input Engine), a novel architecture that resolves this dual-bottleneck by decoupling 3D reasoning from numerical generation. GEODE augments main VLM with two specialized, plug-and-play modules: Decoupled Rationale Module (DRM) that acts as spatial co-processor, aligning explicit 3D data with 2D visual features via cross-attention and distilling spatial Chain-of-Thought (CoT) logic into injectable Rationale Tokens; and Direct Regression Head (DRH), an "Embedding-as-Value" paradigm which routes specialized control tokens to a lightweight MLP for precise, continuous regression of scalars and 3D bounding boxes. The synergy of these modules allows our 1.5B parameter model to function as a high-level semantic dispatcher, achieving state-of-the-art spatial reasoning performance that rivals 7B+ models.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 47 references that are in the map. First posted on arXiv 14 Nov 2025.
Builds on
32 of 47 references.
Closest ancestors · 10
Same direction, newest first
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks29 Oct
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
- 2025MindJourney: Test-Time Scaling with World Models for Spatial Reasoning16 Jul
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
- 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning18 May
- 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Models1 May
- 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning28 Apr
- 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models25 Mar
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
Other references · 22
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Long Context Transfer from Language to Visioncited by 502
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 146
- 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 131
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
10 more
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
- 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 74
- 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 72
- 2025Multi-SpatialMLLM: Multi-Frame Spatial Understanding with Multi-Modal Large Language Modelscited by 52
- 2025Video-XL-Pro: Reconstructive Token Compression for Extremely Long Video Understandingcited by 49
- 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 37
- 2024Uni3D-LLM: Unifying Point Cloud Perception, Generation and Editing with Large Language Modelscited by 24
- 2025Visuospatial Cognitive Assistantcited by 11
- 2025RynnEC: Bringing MLLMs into Embodied Worldcited by 11
- 2025TAMMs: Change Understanding and Forecasting in Satellite Image Time Series with Temporal-Aware Multimodal Modelscited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoningcited by 11
- 2026Can LLMs See Without Pixels? Benchmarking Spatial Intelligence from Textual Descriptionscited by 7
- 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoningcited by 2
- 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoningcited by 1
- 2026Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurementcited by 0
- 2026SphMind: Towards Robust, Training-Free VLM-based Spatial Reasoning with a 360 Cameracited by 0
- 2026ChronoGraph: Functional 4D Scene Graphs with Vision-Language Models for Interaction Understanding and Grounded Planningcited by 0
- 2026ChronoGraph: Functional 4D Scene Graphs with Vision-Language Models for Interaction Understanding and Grounded Planning30 Sep 2026
- 2026SphMind: Towards Robust, Training-Free VLM-based Spatial Reasoning with a 360 Camera27 Sep 2026
- 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning10 Jun 2026
- 2026ReVSI: Rebuilding Visual Spatial Intelligence Evaluation for Accurate Assessment of VLM 3D Reasoning27 Apr 2026
- 2026Enhancing MLLM Spatial Understanding via Active 3D Scene Exploration for Multi-Perspective Reasoning8 Apr 2026
- 2026Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurement6 Mar 2026
- 2026Can LLMs See Without Pixels? Benchmarking Spatial Intelligence from Textual Descriptions7 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Disentangling 3D Modeling from Spatial Reasoning
- 20263ViewSense: Spatial and Mental Perspective Reasoning from Orthographic Views in Vision-Language Models
- 2025G2VLM: Geometry Grounded Vision Language Model with Unified 3D Reconstruction and Spatial Reasoning
- 2026Make Geometry Matter for Spatial Reasoning
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views
- 2025Pursuing Minimal Sufficiency in Spatial Reasoning
- 2026Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
- 2026Reinforcing Dual-Path Reasoning in Spatial Vision Language Models