mlsanityData to 14 Oct 2026

OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs

arXiv 2606.03890 ↗First posted 2 Jun 2026cs.CVcited by 6

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Multimodal agents in robotics, AR, and autonomous driving must reason about places and layouts from continuous egocentric streams, often using evidence outside the current view. Existing benchmarks either evaluate offline over full videos or target events rather than spatial structure. We introduce OVO-S-Bench, a fully human-annotated benchmark for streaming spatial intelligence, comprising 1,680 questions over 348 source videos. Annotation involves 12 trained annotators (each also serving as a blind cross-reviewer) across roughly 804 person-hours of multi-round quality assurance. Each question carries a query timestamp and an evidence interval, and at evaluation, the model sees only the prefix preceding the query. Questions span four levels of increasing abstraction: instantaneous egocentric perception, spatiotemporal context tracking, generative spatial reasoning, and allocentric spatial mapping. Across 38 proprietary and open-source MLLMs, Gemini-3.1-Pro trails human experts evaluated under the same prefix-access protocol by 33 points (59.2 vs. 92.2), with allocentric spatial mapping as the dominant bottleneck. Notably, streaming and spatially fine-tuned MLLMs underperform their own backbones. We further find that chain-of-thought reasoning amplifies spatial errors when ungrounded in the stream. By exposing these limitations, OVO-S-Bench establishes a demanding testbed for next-generation streaming spatial MLLMs.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 58 of its 65 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

58 of 65 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025SpaceMind: Camera-Guided Modality Fusion for Spatial Reasoning in Vision-Language Models28 Nov
  2. 2025SpatialBench: Benchmarking Multimodal Large Language Models for Spatial Cognition26 Nov
  3. 2025Robobench: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models as Embodied Brain20 Oct
  4. 2025OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understanding10 Jul
  5. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
  6. 2025Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces30 May
  7. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
  8. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence29 May
  9. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models27 May
  10. 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?31 Mar
  11. 2025Open3D-VQA: A Benchmark for Comprehensive Spatial Reasoning with Multimodal Large Language Model in Open Space14 Mar
  12. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
3 more
  1. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models9 Jun
  2. 2024TopViewRS: Vision-Language Models as Top-View Spatial Reasoners4 Jun
  3. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 43

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  4. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  5. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
  6. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 467
  7. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  8. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 410
  9. 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 169
  10. 2024Streaming Long Video Understanding with Large Language Modelscited by 167
  11. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
  12. 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 144
31 more
  1. 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 142
  2. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  3. 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 127
  4. 2018Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoningcited by 102
  5. 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Drivingcited by 100
  6. 2025TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videoscited by 97
  7. 2025StreamingVLM: Real-Time Understanding for Infinite Video Streamscited by 95
  8. 2025Visual Spatial Tuningcited by 89
  9. 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
  10. 2025Flash-VStream: Efficient Real-Time Understanding for Long Video Streamscited by 81
  11. 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 78
  12. 2024Online Video Understanding: OVBench and VideoChat-Onlinecited by 61
  13. 2025InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understandingcited by 58
  14. 2026Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understandingcited by 55
  15. 2025StreamingTOM: Streaming Token Compression for Efficient Video Understandingcited by 43
  16. 2026HERMES: KV Cache as Hierarchical Memory for Efficient Streaming Video Understandingcited by 41
  17. 2024Aria Everyday Activities Datasetcited by 39
  18. 2026RoboBrain 2.5: Depth in Sight, Time in Mindcited by 39
  19. 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligencecited by 38
  20. 2026RynnBrain: Open Embodied Foundation Modelscited by 35
  21. 2026A Simple Baseline for Streaming Video Understandingcited by 33
  22. 2026FluxMem: Adaptive Hierarchical Memory for Streaming Video Understandingcited by 28
  23. 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 26
  24. 2024RoomTour3D: Geometry-Aware Video-Instruction Tuning for Embodied Navigationcited by 23
  25. 2025DSI-Bench: A Benchmark for Dynamic Spatial Intelligencecited by 23
  26. 2025StreamEQA: Towards Streaming Video Understanding for Embodied Scenarioscited by 12
  27. 2025SpatialTree: How Spatial Abilities Branch Out in MLLMscited by 12
  28. 2026Spatial-TTT: Streaming Visual-based Spatial Intelligence with Test-Time Trainingcited by 11
  29. 2025Out of Sight, Not Out of Context? Egocentric Spatial Reasoning in VLMs Across Disjoint Framescited by 6
  30. 2026Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligencecited by 6
  31. 2026SVCBench: A Streaming Video Counting Benchmark for Spatial-Temporal State Maintenancecited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026See, Remember, Explore: A Benchmark and Baselines for Streaming Spatial Reasoning
  2. 2026Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams
  3. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
  4. 2026DRIVESPATIAL: A Benchmark for Spatiotemporal Intelligence in VLMs for Autonomous Driving
  5. 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligence
  6. 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models
  7. 2026From Where Things Are to What They Are For: Benchmarking Spatial-Functional Intelligence in Multimodal LLMs
  8. 2026Minerva-Ego: Spatiotemporal Hints for Egocentric Video Understanding