WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictors
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Commercial video generation systems such as Seedance2.0 and Veo3.1 have rapidly improved, strengthening the view that video generators may be evolving into "world simulators." Yet the community still lacks a benchmark that directly tests whether a model can reason about how an observed world should evolve over time. We introduce WorldReasonBench, which reframes video generation evaluation as world-state prediction: given an initial state and an action, can a model generate a future video whose state evolution remains physically, socially, logically, and informationally consistent? WorldReasonBench contains 436 curated test cases with structured ground-truth QA annotations spanning four reasoning dimensions and 22 subcategories. We evaluate generated videos with a human-aligned two-part methodology: Process-aware Reasoning Verification uses structured QA and reasoning-phase diagnostics to detect temporal and causal failures, while Multi-dimensional Quality Assessment scores reasoning quality, temporal consistency, and visual aesthetics for ranking and reward modeling. We further introduce WorldRewardBench, a preference benchmark with approximately 6K expert-annotated pairs over 1.4K videos, supporting pair-wise and point-wise reward-model evaluation. Across modern video generators, our results expose a persistent gap between visual plausibility and world reasoning: videos can look convincing while failing dynamics, causality, or information preservation. We will release our benchmarks and evaluation toolkit to support community research on genuinely world-aware video generation at https://github.com/UniX-AI-Lab/WorldReasonBench/.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 23 of its 31 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
23 of 31 references.
References · 23
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2025Video models are zero-shot learners and reasonerscited by 220
11 more
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 122
- 2025VideoScore2: Think before You Score in Generative Video Evaluationcited by 40
- 2026A Very Big Video Reasoning Suitecited by 34
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Modelscited by 22
- 2025VideoEval-Pro: Robust and Realistic Long Video Understanding Evaluationcited by 21
- 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmarkcited by 19
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 13
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026A Definition and Roadmap for World Modelscited by 5
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Modelscited by 3
- 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuationcited by 1
- 2026SCOPE: Score-Isolated Agentic Optimization for Video World Modelscited by 0
- 2026OmniCapBench: A Deep-Structured Evaluation Framework for Fine-Grained Audio-Visual Captioningcited by 0
- 2026OmniCapBench: A Deep-Structured Evaluation Framework for Fine-Grained Audio-Visual Captioning8 Oct 2026
- 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuation3 Sep 2026
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models20 Aug 2026
- 2026SCOPE: Score-Isolated Agentic Optimization for Video World Models15 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025WorldModelBench: Judging Video Generation Models As World Models
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
- 2026PAWBench: How Far Are We from Probabilistically Aligned World Modeling?
- 2026HappyWorld-Bench
- 2026StateCraft: Augmenting Video World Models with Abstract-State Reasoning
- 2026Nano World Models: A Minimalist Implementation of Future Video Prediction
- 2026World Action Models: A Survey
- 2026Video-Arena: A Scalable Agentic Video Benchmark for Spatiotemporal Capability