mlsanityData to 14 Oct 2026

ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models

arXiv 2605.10106 ↗First posted 11 May 2026cs.CV cs.AIcited by 4

On the map: LLM reasoning → Spatial and embodied reasoning

also in 2 more
Abstract (arXiv)

Recent advances in Multi-modal Large Language Models (MLLMs) target 3D spatial intelligence, yet the progress has been largely driven by post-training on curated benchmarks, leaving the inference-time approach relatively underexplored. In this paper, we take a training-free perspective and introduce ViSRA, a human-aligned Video-based Spatial Reasoning Agent, as a framework to probe the spatial reasoning mechanism of MLLMs. ViSRA elicits spatial reasoning in a modular and extensible manner by leveraging explicit spatial information from expert models, enabling a plug-and-play flexible paradigm. ViSRA offers two key advantages: (1) human-aligned and transferable 3D understanding rather than task-specific overfitting; and (2) no post-training computational cost along with heavy manual curation of spatial reasoning datasets. Experimental results demonstrate consistent improvement across a set of MLLMs on both existing benchmarks and unseen 3D spatial reasoning tasks, with ViSRA outperforming baselines by up to a 15.6% and 28.9% absolute margin respectively.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 46 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

43 of 46 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods14 Nov
  2. 2025Reasoning in Space via Grounding in the World15 Oct
  3. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  4. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  5. 2025How to Enable LLM with 3D Capacity? A Survey of Spatial Reasoning in LLM8 Apr
  6. 2025ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videos16 Mar
  7. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  8. 2024Coarse Correspondences Boost Spatial-Temporal Reasoning in Multimodal Language Model1 Aug

Other references · 35

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  8. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  9. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  10. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  11. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  12. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
23 more
  1. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  2. 2025SAM 3: Segment Anything with Conceptscited by 906
  3. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  4. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  5. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  6. 2023Track Anything: Segment Anything Meets Videoscited by 234
  7. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 229
  8. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 217
  9. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  10. 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 160
  11. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 153
  12. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  13. 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 120
  14. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 109
  15. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
  16. 2025Visual Spatial Tuningcited by 89
  17. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
  18. 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 79
  19. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 73
  20. 2025Detect Anything via Next Point Predictioncited by 73
  21. 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 38
  22. 2025OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understandingcited by 24
  23. 2025Towards Visuospatial Cognition via Hierarchical Fusion of Visual Expertscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
  2. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
  3. 2026Unleashing Spatial Reasoning in Multimodal Large Language Models via Textual Representation Guided Reasoning
  4. 2026EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMs
  5. 2026GraFT: A Training-Free Framework for Spatial Reasoning in Multimodal Large Language Models via 3D Scene Graphs
  6. 2026Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models
  7. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
  8. 2025Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models