SCP: Spatial Causal Prediction in Video
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Spatial reasoning, the ability to understand spatial relations, causality, and dynamic evolution, is central to human intelligence and essential for real-world applications such as autonomous driving and robotics. Existing studies, however, primarily assess models on visible spatio-temporal understanding, overlooking their ability to infer unseen past or future spatial states. In this work, we introduce Spatial Causal Prediction (SCP), a new task paradigm that challenges models to reason beyond observation and predict spatial causal outcomes. We further construct SCP-Bench, a benchmark comprising 2,500 QA pairs across 1,181 videos spanning diverse viewpoints, scenes, and causal directions, to support systematic evaluation. Through comprehensive experiments on {23} state-of-the-art models, we reveal substantial gaps between human and model performance, limited temporal extrapolation, and weak causal grounding. We further analyze key factors influencing performance and propose perception-enhancement and reasoning-guided strategies toward advancing spatial causal intelligence. The project page is https://guangstrip.github.io/SCP-Bench.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 59 of its 71 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
59 of 71 references.
Closest ancestors · 14
Same direction, newest first
- 2025Actial: Activate Spatial Reasoning Ability of Multimodal Large Language Models3 Nov
- 2025How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective23 Sep
- 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture2 Sep
- 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models23 Jun
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Models3 Jun
- 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understanding2 Jun
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning18 Mar
- 2025Spatial457: A Diagnostic Benchmark for 6D Spatial Reasoning of Large Multimodal Models12 Feb
- 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
2 more
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen3 Technical Reportcited by 8,195
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Qwen Technical Reportcited by 3,273
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2018World Modelscited by 1,444
33 more
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2021Transformers in Vision: A Surveycited by 1,009
- 2025OpenAI GPT-5 System Cardcited by 910
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
- 2025Qwen3-Omni Technical Reportcited by 451
- 2016YouTube-8M: A Large-Scale Video Classification Benchmarkcited by 324
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 176
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 151
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 147
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 146
- 2024Tarsier: Recipes for Training and Evaluating Large Video Description Modelscited by 140
- 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 133
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
- 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 101
- 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 100
- 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
- 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 74
- 2024A Survey for Foundation Models in Autonomous Drivingcited by 51
- 2024Towards Semantic Equivalence of Tokenization in Multimodal LLMcited by 45
- 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Modelscited by 35
- 2025DSI-Bench: A Benchmark for Dynamic Spatial Intelligencecited by 20
- 2021ERQA: Edge-Restoration Quality Assessment for Video Super-Resolutioncited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoning
- 2026From Sight to Foresight: Predictive Spatial Reasoning in Vision-Language Models
- 2024Causal Deciphering and Inpainting in Spatio-Temporal Dynamics via Diffusion Model
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environments
- 2026Spatial-Interactor: Learning Spatial Reasoning through Interaction with the Observable Physical World
- 2026Beyond Spatial Benchmarks: From Spatial Reasoning to Navigation
- 2026Vision-language models lag human performance on physical dynamics and intent reasoning
- 2026VCN-Bench: A Video-Contextualized Navigation Benchmark for Spatial Reasoning over Prior Visual Experience