YoCausal: How Far is Video Generation from World Model? A Causality Perspective
On the map: World models → Video-generation world models and simulators
also in 1 more
Abstract (arXiv)
As video diffusion models (VDMs) advance toward world models, a key question arises: do they truly understand causality, or merely overfit to statistical temporal patterns? Existing benchmarks mostly rely on synthetic data, limiting real-world generalization due to the sim-to-real gap. We present YoCausal, a two-level benchmark inspired by the Violation of Expectation (VoE) paradigm from cognitive science. By temporally reversing real-world videos at zero cost as natural counterfactual samples, YoCausal establishes an arbitrarily extensible evaluation protocol. Level 1 introduces the Reverse Surprise Index (RSI), quantifying arrow-of-time perception via denoising loss. Level 2 introduces the Causality Cognition Index (CCI), which leverages a VLM to stratify datasets into causal and non-causal subsets, disentangling genuine causal reasoning from temporal bias. Evaluation of 13 state-of-the-art VDMs reveals that perceiving the arrow of time does not imply understanding causality, and a significant gap persists relative to human-level causal cognition. Project page: https://www.youzhexie.me/papers/YoCausal/
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 132 of its 184 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
132 of 184 references.
Closest ancestors · 17
Same direction, newest first
- 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models22 May
- 2026Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models23 Mar
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2025WorldModelBench: Judging Video Generation Models As World Models28 Feb
- 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
- 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond6 May
- 2024Genie: Generative Interactive Environments23 Feb
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
5 more
- 2023Learning Interactive Real-World Simulators9 Oct
- 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 115
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen3 Technical Reportcited by 8,195
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2024GPT-4o System Cardcited by 4,467
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2022Video Diffusion Modelscited by 2,280
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
38 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2018World Modelscited by 1,444
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2021Variational Diffusion Modelscited by 1,145
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 451
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 348
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 310
- 2023Photorealistic Video Generation with Diffusion Modelscited by 304
- 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 301
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 293
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
- 2017Unsupervised Representation Learning by Sorting Sequencescited by 219
50 most cited of 115 All 115 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Thinking in Video: Can Video Generators Really Reason About the Real World?
- 2026Video-Mirai: Autoregressive Video Diffusion Models Need Foresight
- 2025Causally Steered Diffusion for Automated Video Counterfactual Generation
- 2026Causality in Video Diffusers is Separable from Denoising
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
- 2025VideoVerse: Does Your T2V Generator Have World Model Capability to Synthesize Videos?
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Models
- 2026The Seriality Gap in Video Diffusion Models