mlsanityData to 7 Oct 2026

GeoSense: Internalizing Geometric Necessity Perception for Multimodal Reasoning

arXiv 2603.10370 ↗First posted 11 Mar 2026cs.CVcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Advancing towards artificial superintelligence requires rich and intelligent perceptual capabilities. A critical frontier in this pursuit is overcoming the limited spatial understanding of Multimodal Large Language Models (MLLMs), where geometry information is essential. Existing methods often address this by rigidly injecting geometric signals into every input, while ignoring their necessity and adding computation overhead. Contrary to this paradigm, our framework endows the model with an awareness of perceptual insufficiency, empowering it to autonomously engage geometric features in reasoning when 2D cues are deemed insufficient. To achieve this, we first introduce an independent geometry input channel to the model architecture and conduct alignment training, enabling the effective utilization of geometric features. Subsequently, to endow the model with perceptual awareness, we curate a dedicated spatial-aware supervised fine-tuning dataset. This serves to activate the model's latent internal cues, empowering it to autonomously determine the necessity of geometric information. Experiments across multiple spatial reasoning benchmarks validate this approach, demonstrating significant spatial gains without compromising 2D visual reasoning capabilities, offering a path toward more robust, efficient and self-aware multi-modal intelligence.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 28 of its 49 references that are in the map. First posted on arXiv 11 Mar 2026.

Builds on

28 of 49 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  2. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  3. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  4. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
  5. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  6. 2025MLLM-For3D: Adapting Multimodal Large Language Model for 3D Reasoning Segmentation23 Mar
  7. 2024TopViewRS: Vision-Language Models as Top-View Spatial Reasoners4 Jun

Other references · 21

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  4. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  5. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  6. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  7. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  8. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 281
  9. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
  10. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  11. 2024Direct Preference Optimization of Video Large Multimodal Models from Language Model Rewardcited by 145
  12. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
9 more
  1. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
  2. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 100
  3. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
  4. 2025Visual Spatial Tuningcited by 85
  5. 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 63
  6. 2025MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoningcited by 45
  7. 2025SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Rewardcited by 45
  8. 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 38
  9. 2025WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Chartscited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thinking with Geometry: Active Geometry Integration for Spatial Reasoning
  2. 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoning
  3. 2026LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Models
  4. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
  5. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
  6. 2026From Where Things Are to What They Are For: Benchmarking Spatial-Functional Intelligence in Multimodal LLMs
  7. 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Tasks
  8. 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes