mlsanityData to 7 Oct 2026

EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMs

arXiv 2604.03318 ↗First posted 1 Apr 2026cs.CVcited by 3

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models (MLLMs) are increasingly being applied to spatial cognition tasks, where they are expected to understand and interact with complex environments. Most existing works improve spatial reasoning by introducing 3D priors or geometric supervision, which enhances performance but incurs substantial data preparation and alignment costs. In contrast, purely 2D approaches often struggle with multi-frame spatial reasoning due to their limited ability to capture cross-frame spatial relationships. To address these limitations, we propose EgoMind, a Chain-of-Thought framework that enables geometry-free spatial reasoning through Role-Play Caption, which jointly constructs a coherent linguistic scene graph across frames, and Progressive Spatial Analysis, which progressively reasons toward task-specific questions. With only 5K auto-generated SFT samples and 20K RL samples, EgoMind achieves competitive results on VSI-Bench, SPAR-Bench, SITE-Bench, and SPBench, demonstrating its effectiveness in strengthening the spatial reasoning capabilities of MLLMs and highlighting the potential of linguistic reasoning for spatial cognition. Code and data are released at https://github.com/Hyggge/EgoMind.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 62 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

32 of 62 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  2. 2025Reasoning in Space via Grounding in the World15 Oct
  3. 2025SpaceVista: All-Scale Visual Spatial Reasoning from mm to km10 Oct
  4. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  5. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  6. 2025Struct2D: A Perception-Guided Framework for Spatial Reasoning in MLLMs4 Jun
  7. 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understanding2 Jun
  8. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  9. 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr

Other references · 23

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  4. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  6. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  7. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 501
  8. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  9. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 450
  10. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
  11. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  12. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 178
11 more
  1. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
  2. 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 171
  3. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
  4. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
  5. 2023Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenescited by 125
  6. 2024Grounded 3D-LLM with Referent Tokenscited by 111
  7. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 106
  8. 2025Ovis2.5 Technical Reportcited by 103
  9. 2025Skywork R1V: Pioneering Multimodal Reasoning with Chain-of-Thoughtcited by 69
  10. 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 49
  11. 2025See&Trek: Training-Free Spatial Prompting for Multimodal Large Language Modelcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
  2. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
  3. 2026Unleashing Spatial Reasoning in Multimodal Large Language Models via Textual Representation Guided Reasoning
  4. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
  5. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition
  6. 2026ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models
  7. 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
  8. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models