mlsanityData to 14 Oct 2026

GeoReader: Learning Latent Geometry for Spatial Reasoning in Vision-Language Models

arXiv 2610.18694 ↗First posted 13 Oct 2026cs.CV cs.AI cs.LGcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Vision-language models (VLMs) struggle with metric and multi-view relationships that remain implicit in RGB observations. Geometry foundation models recover this structure from RGB, but existing methods either fuse the estimated features with visual tokens and learn to use them from question answering alone, or align VLM latents with geometry features. Capturing geometry, however, does not ensure its use: zeroing the aligned latents of a released feature-alignment model leaves its accuracy unchanged. We introduce GeoReader, a framework that learns geometric representations for the VLM that reads them. First, we train lightweight Geometric Readers to produce continuous input tokens, supervising them with geometry descriptions decoded by a frozen VLM, so that the Readers express geometry in a form the target model can already read. We then freeze the Readers to preserve this interface while fine-tuning the VLM on spatial QA, with geometry injection conditioned on the question. Geometry descriptions serve only as training targets: at inference, the VLM answers directly from the continuous geometric tokens without generating a geometry chain of thought. With geometry predicted from RGB images, our approach reaches 94.3 on MindCube-Tiny with Qwen3-VL-4B and, with a multi-source QA mixture, an average of 72.5 across six additional spatial benchmarks with Qwen3.5-9B. These results suggest that a useful geometric representation is one the receiving model can use, not merely one from which geometry can be reconstructed.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 70 of its 80 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

70 of 80 references.

Closest ancestors · 21

Same direction, newest first

  1. 2026SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models3 Aug
  2. 2026Dense Reward for Multi-View 3D Reasoning with Global Maps and Local Views22 Jun
  3. 2026SpatialStack: Layered Geometry-Language Fusion for 3D VLM Spatial Reasoning28 Mar
  4. 2026Make Geometry Matter for Spatial Reasoning27 Mar
  5. 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Models26 Mar
  6. 2026GAP-MLLM: Geometry-Aligned Pre-training for Activating 3D Spatial Perception in Multimodal Large Language Models17 Mar
  7. 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models9 Feb
  8. 2025N3D-VLM: Native 3D Grounding Enables Accurate Spatial Reasoning in Vision-Language Models18 Dec
  9. 2025SpaceMind: Camera-Guided Modality Fusion for Spatial Reasoning in Vision-Language Models28 Nov
  10. 2025G2VLM: Geometry Grounded Vision Language Model with Unified 3D Reconstruction and Spatial Reasoning26 Nov
  11. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  12. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
9 more
  1. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  2. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
  3. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  4. 2025SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data29 Apr
  5. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  6. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  7. 2024An Empirical Analysis on Spatial Reasoning Capabilities of Large Multimodal Models9 Nov
  8. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  9. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 49

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  6. 2025Qwen3-VL Technical Reportcited by 2,793
  7. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  9. 2024Depth Anything V2cited by 1,422
  10. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  11. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  12. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
37 more
  1. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  2. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
  3. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  4. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  5. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  6. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  7. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  8. 2023An Embodied Generalist Agent in 3D Worldcited by 365
  9. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  10. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
  11. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 183
  12. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  13. 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 160
  14. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
  15. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 138
  16. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
  17. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
  18. 2025Latent Visual Reasoningcited by 104
  19. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
  20. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
  21. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Languagecited by 82
  22. 2026DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compressioncited by 76
  23. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokenscited by 71
  24. 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 67
  25. 20253D Aware Region Prompted Vision Language Modelcited by 33
  26. 2025SD-VLM: Spatial Measuring and Understanding with Depth-Encoded Vision-Language Modelscited by 25
  27. 2026Imagination Helps Visual Reasoning, But Not Yet in Latent Spacecited by 12
  28. 2026Spatial-TTT: Streaming Visual-based Spatial Intelligence with Test-Time Trainingcited by 11
  29. 2026What's Holding Back Latent Visual Reasoning?cited by 7
  30. 2026Leveraging Latent Visual Reasoning in Silencecited by 5
  31. 2026Beyond Visual Memory: Mechanistic Diagnostics of Latent Visual Reasoningcited by 5
  32. 2026Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMscited by 4
  33. 2025Global-Aware Monocular Semantic Scene Completion with State Space Modelscited by 3
  34. 2026Towards in-the-wild Egocentric 3D Hand-Object Pose Estimationcited by 2
  35. 2026Reason Through the Latent! Making Latent Visual Reasoning Necessarycited by 2
  36. 2026Token-Wise Latent Streaming from Slow Reasoners to Fast Planners for Dynamic Vision Language Navigationcited by 1
  37. 2026MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvementcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GeoLatent: Geometry-Guided Latent Structuring with Routed Optimization for 3D Reasoning
  2. 2023GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoning
  3. 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning
  4. 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understanding
  5. 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Models
  6. 2026Geometry-Aware Test-Time Learning for Quantitative Spatial Reasoning
  7. 2026Beyond 3D VQAs: Injecting 3D Spatial Priors into Vision-Language Models for Enhanced Geometric Reasoning
  8. 2026GeoWorld-VLM: Geometry from World Models for Vision-Language Models