Video-MSR: Benchmarking Multi-hop Spatial Reasoning Capabilities of MLLMs
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Spatial reasoning has emerged as a critical capability for Multimodal Large Language Models (MLLMs), drawing increasing attention and rapid advancement. However, existing benchmarks primarily focus on single-step perception-to-judgment tasks, leaving scenarios requiring complex visual-spatial logical chains significantly underexplored. To bridge this gap, we introduce Video-MSR, the first benchmark specifically designed to evaluate Multi-hop Spatial Reasoning (MSR) in dynamic video scenarios. Video-MSR systematically probes MSR capabilities through four distinct tasks: Constrained Localization, Chain-based Reference Retrieval, Route Planning, and Counterfactual Physical Deduction. Our benchmark comprises 3,052 high-quality video instances with 4,993 question-answer pairs, constructed via a scalable, visually-grounded pipeline combining advanced model generation with rigorous human verification. Through a comprehensive evaluation of 20 state-of-the-art MLLMs, we uncover significant limitations, revealing that while models demonstrate proficiency in surface-level perception, they exhibit distinct performance drops in MSR tasks, frequently suffering from spatial disorientation and hallucination during multi-step deductions. To mitigate these shortcomings and empower models with stronger MSR capabilities, we further curate MSR-9K, a specialized instruction-tuning dataset, and fine-tune Qwen-VL, achieving a +7.82% absolute improvement on Video-MSR. Our results underscore the efficacy of multi-hop spatial instruction data and establish Video-MSR as a vital foundation for future research. The code and data will be available at https://github.com/ruiz-nju/Video-MSR.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 36 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
33 of 36 references.
Closest ancestors · 7
Same direction, newest first
- 2025MMPerspective: Do MLLMs Understand Perspective? A Comprehensive Benchmark for Perspective Perception, Reasoning, and Robustness26 May
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2025Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas3 Mar
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
- 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoning30 Oct
- 2022Visual Spatial Reasoning30 Apr
Other references · 26
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
14 more
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 559
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
- 2025LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understandingcited by 57
- 2025VideoMathQA: Benchmarking Mathematical Reasoning via Multimodal Understanding in Videoscited by 23
- 2025FingerCap: Fine-grained Finger-level Hand Motion Captioningcited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026SATURN: Symbolic Spatial Reasoning for Multi-Perspective Groundingcited by 2
- 2026PinpointQA: A Benchmark for Small Object-Centric Spatial Understanding in Indoor Videoscited by 0
- 2026Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Imagescited by 0
- 2026VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesiscited by 0
- 2026ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligencecited by 0
- 2026ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligence16 Aug 2026
- 2026SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding21 Jun 2026
- 2026VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis21 May 2026
- 2026Beyond Localization: A Comprehensive Diagnosis of Perspective-Conditioned Spatial Reasoning in MLLMs from Omnidirectional Images12 May 2026
- 2026PinpointQA: A Benchmark for Small Object-Centric Spatial Understanding in Indoor Videos10 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning
- 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models
- 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
- 2025From Indoor to Open World: Revealing the Spatial Reasoning Gap in MLLMs
- 2025Cube Bench: A Benchmark for Spatial Visual Reasoning in MLLMs
- 2026MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model
- 2026ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models