mlsanityData to 14 Oct 2026

Video2Layout: Recall and Reconstruct Metric-Grounded Cognitive Map for Spatial Reasoning

arXiv 2511.16160 ↗First posted 20 Nov 2025cs.CVcited by 4

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Spatial intelligence is a critical frontier for Multimodal Large Language Models (MLLMs), empowering them to comprehend the physical world. Drawing inspiration from human perception mechanisms, prior studies attempt to construct a spatial understanding via grid-based cognitive maps. However, current grid-based map methods rely on discretized representations, which limit the model's ability in fine-grained spatial reasoning. To overcome this limitation, we propose Video2Layout, a framework for reconstructing metric-grounded spatial layouts from video. The framework uses continuous object boundary coordinates to enable quantitative spatial computation, which effectively reduces ambiguity in natural language descriptions of spatial relationships. Specifically, our method comprises two stages. First, in supervised fine-tuning stage, we construct a high-quality dataset from the AI2THOR simulator, which enables the model to learn the mapping from visual inputs to precise boundary coordinates. Subsequently, a reinforcement fine-tuning stage enhances the model's real-world generalization capabilities. Based on the above framework, we investigate factors that affect cognitive map accuracy and quantify its relationship with task performance. Evaluated on mainstream spatial reasoning benchmarks, our model, V2LO-7B, achieves an average improvement of 3.24% over the model trained on grid maps, validating the superiority of our method.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 44 of its 49 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

44 of 49 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks29 Oct
  2. 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective11 Sep
  3. 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes8 Sep
  4. 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture2 Sep
  5. 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understanding31 Jul
  6. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
  7. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
  8. 2025SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization2 Jun
  9. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  10. 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning18 May
  11. 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning28 Apr
  12. 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learning17 Apr
7 more
  1. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  2. 2025ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videos16 Mar
  3. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  4. 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models15 Sep
  5. 2024TopViewRS: Vision-Language Models as Top-View Spatial Reasoners4 Jun
  6. 2024SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors18 Mar
  7. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 25

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  5. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  6. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  7. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
  8. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
  9. 2024Video-3D LLM: Learning Position-Aware Video Representation for 3D Scene Understandingcited by 138
  10. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
  11. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  12. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 109
13 more
  1. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
  2. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
  3. 2024Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphscited by 73
  4. 2025Multi-SpatialMLLM: Multi-Frame Spatial Understanding with Multi-Modal Large Language Modelscited by 52
  5. 2025Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learningcited by 41
  6. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
  7. 2025Visuospatial Cognitive Assistantcited by 11
  8. 2025CookBench: A Long-Horizon Embodied Planning Benchmark for Complex Cooking Scenarioscited by 11
  9. 2025From reactive to cognitive: brain-inspired spatial intelligence for embodied agentscited by 7
  10. 2024Visual Localization in 3D Maps: Comparing Point Cloud, Mesh, and NeRF Representationscited by 4
  11. 2024Learning Dynamic Cognitive Map with Autonomous Navigationcited by 3
  12. 2025VLM-3D:End-to-End Vision-Language Models for Open-World 3D Perceptioncited by 3
  13. 2025MapFM: Foundation Model-Driven HD Mapping with Multi-Task Contextual Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026World2Mind: Cognition Toolkit for Allocentric Spatial Reasoning in Foundation Models
  2. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
  3. 2026KilometerVision: A New Frontier for Large-Scale Spatial Intelligence in VLMs
  4. 2026CoCoSI: Collaborative Cognitive Map Construction for Spatial Intelligence
  5. 2026From Reasoning Failures to Composable Video Spatial Intelligence
  6. 2026SpatialText: A Pure-Text Cognitive Benchmark for Spatial Understanding in Large Language Models
  7. 2025SIMS-V: Simulated Instruction-Tuning for Spatial Video Understanding
  8. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition