DSI-Bench: A Benchmark for Dynamic Spatial Intelligence
Not on the map. Why?
Abstract (arXiv)
Reasoning about dynamic spatial relationships is essential, as both observers and objects often move simultaneously. Although vision-language models (VLMs) and visual expertise models excel in 2D tasks and static scenarios, their ability to fully understand dynamic 3D scenarios remains limited. We introduce Dynamic Spatial Intelligence and propose DSI-Bench, a benchmark with nearly 1,000 dynamic videos and over 1,700 manually annotated questions covering nine decoupled motion patterns of observers and objects. Spatially and temporally symmetric designs reduce biases and enable systematic evaluation of models' reasoning about self-motion and object motion. Our evaluation of 14 VLMs and expert models reveals key limitations: models often conflate observer and object motion, exhibit semantic biases, and fail to accurately infer relative relationships in dynamic scenarios. Our DSI-Bench provides valuable findings and insights about the future development of general and expertise models with dynamic spatial intelligence.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 18 of its 24 references that are in the map. First posted on arXiv 21 Oct 2025.
Builds on
18 of 24 references.
References · 18
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 183
- 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmarkcited by 139
6 more
- 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
- 2020A Short Note on the Kinetics-700-2020 Human Action Datasetcited by 92
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 87
- 2025Towards Understanding Camera Motions in Any Videocited by 64
- 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Modelscited by 46
- 2024Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Modelscited by 45
Built on by
Citing papers per year: 2025: 3; 2026: 20.
23 papers.
Sort:
By area:
- 2026SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoningcited by 17
- 2026TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformerscited by 14
- 2026Thinking in Dynamics: How Multimodal Large Language Models Perceive, Track, and Reason Dynamics in Physical 4D Worldcited by 12
- 2026OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMscited by 6
- 2025IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigationcited by 5
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoningcited by 5
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understandingcited by 4
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 4
- 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spacescited by 3
- 2026Planning with the Viewscited by 3
- 2026What if? Emulative Simulation with World Models for Situated Reasoningcited by 2
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMscited by 2
11 more
- 2026ReSTI: A Source-Grounded Audit and Repair of STI-Benchcited by 2
- 2025DynaSolidGeo: A Dynamic Benchmark for Genuine Spatial Mathematical Reasoning of VLMs in Solid Geometrycited by 1
- 2026Modeling Cross-vision Synergy for Unified Large Vision Modelcited by 1
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?cited by 1
- 2025Thinking Ahead: Foresight Intelligence in MLLMs and World Modelcited by 0
- 2026SCP: Spatial Causal Prediction in Videocited by 0
- 2026From Reasoning Failures to Composable Video Spatial Intelligencecited by 0
- 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Modelscited by 0
- 2026WOVEN: Weaving Visual World Modeling into Multimodal LLMscited by 0
- 2026EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agentscited by 0
- 2026DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoningcited by 0
- 2026DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning14 Oct 2026
- 2026EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents12 Oct 2026
- 2026WOVEN: Weaving Visual World Modeling into Multimodal LLMs8 Oct 2026
- 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models8 Oct 2026
- 2026From Reasoning Failures to Composable Video Spatial Intelligence1 Oct 2026
- 2026ReSTI: A Source-Grounded Audit and Repair of STI-Bench21 Sep 2026
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?23 Jul 2026
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs14 Jul 2026
- 2026SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning11 Jun 2026
- 2026InternVideo3: Agentify Foundation Models with Multimodal Contextual Reasoning10 Jun 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs2 Jun 2026
11 more
- 2026Planning with the Views28 May 2026
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding7 May 2026
- 2026Thinking in Dynamics: How Multimodal Large Language Models Perceive, Track, and Reason Dynamics in Physical 4D World13 Mar 2026
- 2026What if? Emulative Simulation with World Models for Situated Reasoning6 Mar 2026
- 2026SCP: Spatial Causal Prediction in Video4 Mar 2026
- 2026Modeling Cross-vision Synergy for Unified Large Vision Model3 Mar 2026
- 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces8 Feb 2026
- 2026TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformers20 Jan 2026
- 2025Thinking Ahead: Foresight Intelligence in MLLMs and World Model24 Nov 2025
- 2025IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigation21 Nov 2025
- 2025DynaSolidGeo: A Dynamic Benchmark for Genuine Spatial Mathematical Reasoning of VLMs in Solid Geometry25 Oct 2025
- 2026SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoningcited by 17
- 2026Thinking in Dynamics: How Multimodal Large Language Models Perceive, Track, and Reason Dynamics in Physical 4D Worldcited by 12
- 2025IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigationcited by 5
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understandingcited by 4
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 4
- 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spacescited by 3
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMscited by 2
- 2025DynaSolidGeo: A Dynamic Benchmark for Genuine Spatial Mathematical Reasoning of VLMs in Solid Geometrycited by 1
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?cited by 1
- 2026SCP: Spatial Causal Prediction in Videocited by 0
- 2026From Reasoning Failures to Composable Video Spatial Intelligencecited by 0
- 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Modelscited by 0
12 most cited of 14 All 14 (JSON)
- 2026DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning14 Oct 2026
- 2026EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents12 Oct 2026
- 2026SpaceCast-Bench: Evaluating Predictive Spatial Reasoning in Vision-Language Models8 Oct 2026
- 2026From Reasoning Failures to Composable Video Spatial Intelligence1 Oct 2026
- 2026ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?23 Jul 2026
- 2026DynTrace: Tracking Dynamic Object Evidence for 4D Spatio-Temporal Reasoning in MLLMs14 Jul 2026
- 2026SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning11 Jun 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 20264DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding7 May 2026
- 2026Thinking in Dynamics: How Multimodal Large Language Models Perceive, Track, and Reason Dynamics in Physical 4D World13 Mar 2026
- 2026SCP: Spatial Causal Prediction in Video4 Mar 2026
- 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces8 Feb 2026
12 newest of 14 All 14 (JSON)
- 2026Planning with the Viewscited by 3
- 2026ReSTI: A Source-Grounded Audit and Repair of STI-Benchcited by 2
- 2026Modeling Cross-vision Synergy for Unified Large Vision Modelcited by 1
- 2026ReSTI: A Source-Grounded Audit and Repair of STI-Bench21 Sep 2026
- 2026Planning with the Views28 May 2026
- 2026Modeling Cross-vision Synergy for Unified Large Vision Model3 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligence
- 2026From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Models
- 2026World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning
- 2026Which Pretraining Paradigm Better Serves Spatial Intelligence? An Empirical Comparison of Vision-Language and Video Generation Models
- 2025How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective
- 2026KilometerVision: A New Frontier for Large-Scale Spatial Intelligence in VLMs
- 2025SITE: towards Spatial Intelligence Thorough Evaluation
- 2025Reasoning Path and Latent State Analysis for Multi-view Visual Spatial Reasoning: A Cognitive Science Perspective