ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models
On the map: LLM reasoning → Spatial and embodied reasoning
also in 2 more
Abstract (arXiv)
Recent advances in Multi-modal Large Language Models (MLLMs) target 3D spatial intelligence, yet the progress has been largely driven by post-training on curated benchmarks, leaving the inference-time approach relatively underexplored. In this paper, we take a training-free perspective and introduce ViSRA, a human-aligned Video-based Spatial Reasoning Agent, as a framework to probe the spatial reasoning mechanism of MLLMs. ViSRA elicits spatial reasoning in a modular and extensible manner by leveraging explicit spatial information from expert models, enabling a plug-and-play flexible paradigm. ViSRA offers two key advantages: (1) human-aligned and transferable 3D understanding rather than task-specific overfitting; and (2) no post-training computational cost along with heavy manual curation of spatial reasoning datasets. Experimental results demonstrate consistent improvement across a set of MLLMs on both existing benchmarks and unseen 3D spatial reasoning tasks, with ViSRA outperforming baselines by up to a 15.6% and 28.9% absolute margin respectively.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 46 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
43 of 46 references.
Closest ancestors · 8
Same direction, newest first
- 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods14 Nov
- 2025Reasoning in Space via Grounding in the World15 Oct
- 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
- 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
- 2025How to Enable LLM with 3D Capacity? A Survey of Spatial Reasoning in LLM8 Apr
- 2025ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videos16 Mar
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024Coarse Correspondences Boost Spatial-Temporal Reasoning in Multimodal Language Model1 Aug
Other references · 35
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
23 more
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2023Track Anything: Segment Anything Meets Videoscited by 234
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 229
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 160
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 153
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
- 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 109
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
- 2025Visual Spatial Tuningcited by 89
- 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
- 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 79
- 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 73
- 2025Detect Anything via Next Point Predictioncited by 73
- 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 38
- 2025OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understandingcited by 24
- 2025Towards Visuospatial Cognition via Hierarchical Fusion of Visual Expertscited by 11
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Modelscited by 0
- 2026From Reasoning Failures to Composable Video Spatial Intelligencecited by 0
- 2026SpatialOPSD: Self-Distilling Spatial Intelligence from Verified Coding Agent Tracescited by 0
- 2026ReTAC: Residual Test-Time Agentic Computation for Video Spatial Reasoningcited by 0
- 2026ReTAC: Residual Test-Time Agentic Computation for Video Spatial Reasoning12 Oct 2026
- 2026SpatialOPSD: Self-Distilling Spatial Intelligence from Verified Coding Agent Traces8 Oct 2026
- 2026From Reasoning Failures to Composable Video Spatial Intelligence1 Oct 2026
- 2026Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Models24 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
- 2026Unleashing Spatial Reasoning in Multimodal Large Language Models via Textual Representation Guided Reasoning
- 2026EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMs
- 2026GraFT: A Training-Free Framework for Spatial Reasoning in Multimodal Large Language Models via 3D Scene Graphs
- 2026Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models
- 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
- 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models