mlsanityData to 7 Oct 2026

SCP: Spatial Causal Prediction in Video

arXiv 2603.03944 ↗First posted 4 Mar 2026cs.CVcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Spatial reasoning, the ability to understand spatial relations, causality, and dynamic evolution, is central to human intelligence and essential for real-world applications such as autonomous driving and robotics. Existing studies, however, primarily assess models on visible spatio-temporal understanding, overlooking their ability to infer unseen past or future spatial states. In this work, we introduce Spatial Causal Prediction (SCP), a new task paradigm that challenges models to reason beyond observation and predict spatial causal outcomes. We further construct SCP-Bench, a benchmark comprising 2,500 QA pairs across 1,181 videos spanning diverse viewpoints, scenes, and causal directions, to support systematic evaluation. Through comprehensive experiments on {23} state-of-the-art models, we reveal substantial gaps between human and model performance, limited temporal extrapolation, and weak causal grounding. We further analyze key factors influencing performance and propose perception-enhancement and reasoning-guided strategies toward advancing spatial causal intelligence. The project page is https://guangstrip.github.io/SCP-Bench.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 59 of its 71 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

59 of 71 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025Actial: Activate Spatial Reasoning Ability of Multimodal Large Language Models3 Nov
  2. 2025How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective23 Sep
  3. 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture2 Sep
  4. 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models23 Jun
  5. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
  6. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
  7. 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understanding2 Jun
  8. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
  9. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  10. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning18 Mar
  11. 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
  12. 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
2 more
  1. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  2. 20243DSRBench: A Comprehensive 3D Spatial Reasoning Benchmark10 Dec

Other references · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  8. 2023Qwen Technical Reportcited by 3,273
  9. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
  10. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  12. 2018World Modelscited by 1,444
33 more
  1. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  2. 2021Transformers in Vision: A Surveycited by 1,009
  3. 2025OpenAI GPT-5 System Cardcited by 910
  4. 2023A Survey on Multimodal Large Language Modelscited by 898
  5. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
  6. 2023A Comprehensive Overview of Large Language Modelscited by 639
  7. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
  8. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  9. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  10. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
  11. 2025Qwen3-Omni Technical Reportcited by 451
  12. 2016YouTube-8M: A Large-Scale Video Classification Benchmarkcited by 324
  13. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  14. 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
  15. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  16. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 176
  17. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
  18. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 151
  19. 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 147
  20. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 146
  21. 2024Tarsier: Recipes for Training and Evaluating Large Video Description Modelscited by 140
  22. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  23. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 133
  24. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
  25. 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 101
  26. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 100
  27. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
  28. 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 74
  29. 2024A Survey for Foundation Models in Autonomous Drivingcited by 51
  30. 2024Towards Semantic Equivalence of Tokenization in Multimodal LLMcited by 45
  31. 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Modelscited by 35
  32. 2025DSI-Bench: A Benchmark for Dynamic Spatial Intelligencecited by 20
  33. 2021ERQA: Edge-Restoration Quality Assessment for Video Super-Resolutioncited by 14

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoning
  2. 2026From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Models
  3. 2024Causal Deciphering and Inpainting in Spatio-Temporal Dynamics via Diffusion Model
  4. 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments
  5. 2026Spatial-Interactor: Learning Spatial Reasoning through Interaction with the Observable Physical World
  6. 2026Beyond Spatial Benchmarks: From Spatial Reasoning to Navigation
  7. 2026Vision-language models lag human performance on physical dynamics and intent reasoning
  8. 2026VCN-Bench: A Video-Contextualized Navigation Benchmark for Spatial Reasoning over Prior Visual Experience