Seeing Across Views: Benchmarking Spatial Reasoning of Vision-Language Models in Robotic Scenes
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of VLMs focus on single-view settings, leaving their ability to integrate multi-view information underexplored. At the same time, multi-camera setups are increasingly standard in robotic platforms, as they provide complementary perspectives to mitigate occlusion and depth ambiguity. Whether VLMs can effectively leverage such multi-view inputs for robotic reasoning therefore remains an open question. To bridge this gap, we introduce MV-RoboBench, a benchmark specifically designed to evaluate the multi-view spatial reasoning capabilities of VLMs in robotic manipulation. MV-RoboBench consists of 1.7k manually curated QA items across eight subtasks, divided into two primary categories: spatial understanding and robotic execution. We evaluate a diverse set of existing VLMs, including both open-source and closed-source models, along with enhanced versions incorporating CoT-inspired techniques. The results show that state-of-the-art models remain far below human performance, underscoring the substantial challenges VLMs face in multi-view robotic perception. Additionally, our analysis uncovers two key findings: (i) spatial intelligence and robotic task execution are positively correlated in multi-view robotic scenarios; and (ii) strong performance on existing general-purpose single-view spatial understanding benchmarks does not reliably translate to success in the robotic spatial tasks assessed by our benchmark. We release MV-RoboBench as an open resource to foster progress in spatially grounded VLMs and VLAs, providing not only data but also a standardized evaluation protocol for multi-view embodied reasoning.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 50 of its 63 references that are in the map. First posted on arXiv 22 Oct 2025.
Builds on
50 of 63 references.
Closest ancestors · 13
Same direction, newest first
- 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes8 Sep
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning18 May
- 2025SpatialLLM: A Compound 3D-Informed Design towards Spatially-Intelligent Large Multimodal Models1 May
- 2025How to Enable LLM with 3D Capacity? A Survey of Spatial Reasoning in LLM8 Apr
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024An Empirical Analysis on Spatial Reasoning Capabilities of Large Multimodal Models9 Nov
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
- 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning18 Mar
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
1 more
- 2022Visual Spatial Reasoning30 Apr
Other references · 37
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Gemma 3 Technical Reportcited by 1,824
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
25 more
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 152
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 135
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 126
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 101
- 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 67
- 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 56
- 2024MC-LLaVA: Multi-Concept Personalized Vision-Language Modelcited by 54
- 2025Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videoscited by 51
- 2024LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Modelcited by 44
- 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Modelscited by 36
- 2025HSSBench: Benchmarking Humanities and Social Sciences Ability for Multimodal Large Language Modelscited by 17
- 2025Does Your 3D Encoder Really Work? When Pretrain-SFT from 2D VLMs Meets 3D VLMscited by 8
- 2025EgoBrain: Synergizing Minds and Eyes For Human Action Understandingcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 19.
20 papers.
Sort:
By area:
- 2026World Action Models are Zero-shot Policiescited by 465
- 2026What Should I Cite? A RAG Benchmark for Academic Citation Predictioncited by 5
- 2026Diffusion Model as a Generalist Segmentation Learnercited by 4
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontierscited by 3
- 2025LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Modelscited by 2
- 2026MultiPress: A Multi-Agent Framework for Interpretable Multimodal News Classificationcited by 2
- 2026SATURN: Symbolic Spatial Reasoning for Multi-Perspective Groundingcited by 2
- 2026Learning Multi-View Spatial Reasoning from Cross-View Relationscited by 1
- 2026Consistent Yet Wrong: Evidence Insensitivity in Spatial Vision-Language Modelscited by 1
- 2026Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoningcited by 1
- 2026RoboPIN: Grounded Embodied Reasoning via Pinned Chain-of-Thoughtcited by 0
- 2026EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectoriescited by 0
8 more
- 2026DINOcular: Self-Supervised Visuospatial Representationscited by 0
- 2026Di2CycleSB: Towards High-Quality Unsupervised Nighttime Visibility Enhancement via Schr"odinger Bridge Transformercited by 0
- 2026JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Predictioncited by 0
- 2026SpatialBlock: Enhancing Spatial Intelligence in LVLMs via Synthetic Block-Stacking Problemcited by 0
- 2026SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigationcited by 0
- 2026Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Modelscited by 0
- 2026SkillWeaver: Agentic Exploration over Neural Interaction Skills for Scalable Robot Data Generationcited by 0
- 2026Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligencecited by 0
- 2026Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligence14 Oct 2026
- 2026SkillWeaver: Agentic Exploration over Neural Interaction Skills for Scalable Robot Data Generation28 Sep 2026
- 2026Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Models24 Sep 2026
- 2026SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigation15 Sep 2026
- 2026SpatialBlock: Enhancing Spatial Intelligence in LVLMs via Synthetic Block-Stacking Problem7 Sep 2026
- 2026JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction30 Aug 2026
- 2026Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning29 Aug 2026
- 2026Di2CycleSB: Towards High-Quality Unsupervised Nighttime Visibility Enhancement via Schr"odinger Bridge Transformer29 Aug 2026
- 2026DINOcular: Self-Supervised Visuospatial Representations27 Aug 2026
- 2026SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding21 Jun 2026
- 2026RoboPIN: Grounded Embodied Reasoning via Pinned Chain-of-Thought14 Jun 2026
- 2026EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectories6 Jun 2026
8 more
- 2026Consistent Yet Wrong: Evidence Insensitivity in Spatial Vision-Language Models1 Jun 2026
- 2026Diffusion Model as a Generalist Segmentation Learner27 Apr 2026
- 2026MultiPress: A Multi-Agent Framework for Interpretable Multimodal News Classification4 Apr 2026
- 2026Learning Multi-View Spatial Reasoning from Cross-View Relations30 Mar 2026
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers5 Mar 2026
- 2026World Action Models are Zero-shot Policies17 Feb 2026
- 2026What Should I Cite? A RAG Benchmark for Academic Citation Prediction21 Jan 2026
- 2025LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models14 Nov 2025
- 2026SATURN: Symbolic Spatial Reasoning for Multi-Perspective Groundingcited by 2
- 2026Learning Multi-View Spatial Reasoning from Cross-View Relationscited by 1
- 2026Consistent Yet Wrong: Evidence Insensitivity in Spatial Vision-Language Modelscited by 1
- 2026Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoningcited by 1
- 2026RoboPIN: Grounded Embodied Reasoning via Pinned Chain-of-Thoughtcited by 0
- 2026JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Predictioncited by 0
- 2026Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Modelscited by 0
- 2026Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligencecited by 0
- 2026Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligence14 Oct 2026
- 2026Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Models24 Sep 2026
- 2026JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction30 Aug 2026
- 2026Modality Fault Lines: Structural Corruptions Reveal Fragile Omni-Modal Reasoning29 Aug 2026
- 2026SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding21 Jun 2026
- 2026RoboPIN: Grounded Embodied Reasoning via Pinned Chain-of-Thought14 Jun 2026
- 2026Consistent Yet Wrong: Evidence Insensitivity in Spatial Vision-Language Models1 Jun 2026
- 2026Learning Multi-View Spatial Reasoning from Cross-View Relations30 Mar 2026
- 2026EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectoriescited by 0
- 2026SpatialBlock: Enhancing Spatial Intelligence in LVLMs via Synthetic Block-Stacking Problemcited by 0
- 2026SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigationcited by 0
- 2026SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigation15 Sep 2026
- 2026SpatialBlock: Enhancing Spatial Intelligence in LVLMs via Synthetic Block-Stacking Problem7 Sep 2026
- 2026EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectories6 Jun 2026
- 2026Diffusion Model as a Generalist Segmentation Learnercited by 4
- 2026Diffusion Model as a Generalist Segmentation Learner27 Apr 2026
- 2026World Action Models are Zero-shot Policiescited by 465
- 2026World Action Models are Zero-shot Policies17 Feb 2026
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontierscited by 3
- 2025LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Modelscited by 2
- 2026DINOcular: Self-Supervised Visuospatial Representationscited by 0
- 2026Di2CycleSB: Towards High-Quality Unsupervised Nighttime Visibility Enhancement via Schr"odinger Bridge Transformercited by 0
- 2026Di2CycleSB: Towards High-Quality Unsupervised Nighttime Visibility Enhancement via Schr"odinger Bridge Transformer29 Aug 2026
- 2026DINOcular: Self-Supervised Visuospatial Representations27 Aug 2026
- 2026OpenFrontier: General Navigation with Visual-Language Grounded Frontiers5 Mar 2026
- 2025LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models14 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026ESPIRE: A Diagnostic Benchmark for Embodied Spatial Reasoning of Vision-Language Models
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation
- 2025ManipBench: Benchmarking Vision-Language Models for Low-Level Robot Manipulation
- 2024Task-oriented Robotic Manipulation with Vision Language Models
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey
- 2026RMMBench: A Comprehensive Benchmark for Robotic Mobile Manipulation
- 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
- 2026Plan-Bench: Can Existing VLMs Go Well Beyond Perception to Reason and Plan in Embodied Worlds?