mlsanityData to 7 Oct 2026

GST-Bench: Can VLMs Develop Global Spatial Awareness from Video?

arXiv 2608.05747 ↗First posted 6 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Spatial intelligence is fundamental to embodied agents, yet existing benchmarks focus on local spatial perception from single or few viewpoints, overlooking global spatial awareness over continuous, long-horizon visual streams. To address this limitation, we introduce the Global-Spatial-Temporal Benchmark (GST-Bench), a VQA benchmark for global spatial intelligence in video understanding, comprising human-verified questions derived from 6,790 minutes of synthetically generated video. It requires models to perform accurate spatial inference from novel viewpoints unseen in the input video and to map egocentric observations onto global top-down images. A comprehensive evaluation of 22 state-of-the-art VLMs exposes a striking gap between models and humans: the strongest zero-shot model attains only 42.68, far below the human score of 79.08. To probe the cause of this gap, we construct GST-Bench-Local and find that models, despite strong local spatial understanding under the same task formulation, still fail to consolidate long-horizon observations into a globally consistent scene representation. We further provide GST-Train, a dataset for global spatial reasoning, as a complementary resource to facilitate future research on this challenge.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 30 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

27 of 30 references.

References · 27

  1. 2024GPT-4o System Cardcited by 4,467
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  5. 2025OpenAI GPT-5 System Cardcited by 910
  6. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  7. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  8. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  9. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  10. 2022Visual Spatial Reasoningcited by 288
  11. 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoningcited by 245
  12. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
15 more
  1. 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
  2. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
  3. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 133
  4. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
  5. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
  6. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Modelscited by 110
  7. 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 74
  8. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 72
  9. 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 47
  10. 2026RoboBrain 2.5: Depth in Sight, Time in Mindcited by 38
  11. 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Modelscited by 34
  12. 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 34
  13. 2025OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understandingcited by 24
  14. 2025Robix: A Unified Model for Robot Interaction, Reasoning and Planningcited by 23
  15. 2025ArtVIP: Articulated Digital Assets of Visual Realism, Modular Interaction, and Physical Fidelity for Robot Learningcited by 14

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025GTR-Bench: Evaluating Geo-Temporal Reasoning in Vision-Language Models
  2. 2026VGenST-Bench: A Benchmark for Spatio-Temporal Reasoning via Active Video Synthesis
  3. 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?
  4. 2025How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective
  5. 2025From Indoor to Open World: Revealing the Spatial Reasoning Gap in MLLMs
  6. 2026World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning
  7. 2026Video-MSR: Benchmarking Multi-hop Spatial Reasoning Capabilities of MLLMs
  8. 2026Assessing Situational and Spatial Awareness of VLMs with Synthetically Generated Video