mlsanityData to 14 Oct 2026

WorldReasonBench: Human-Aligned Stress Testing of Video Generators as Future World-State Predictors

arXiv 2605.10434 ↗First posted 11 May 2026cs.CVcited by 6

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Commercial video generation systems such as Seedance2.0 and Veo3.1 have rapidly improved, strengthening the view that video generators may be evolving into "world simulators." Yet the community still lacks a benchmark that directly tests whether a model can reason about how an observed world should evolve over time. We introduce WorldReasonBench, which reframes video generation evaluation as world-state prediction: given an initial state and an action, can a model generate a future video whose state evolution remains physically, socially, logically, and informationally consistent? WorldReasonBench contains 436 curated test cases with structured ground-truth QA annotations spanning four reasoning dimensions and 22 subcategories. We evaluate generated videos with a human-aligned two-part methodology: Process-aware Reasoning Verification uses structured QA and reasoning-phase diagnostics to detect temporal and causal failures, while Multi-dimensional Quality Assessment scores reasoning quality, temporal consistency, and visual aesthetics for ranking and reward modeling. We further introduce WorldRewardBench, a preference benchmark with approximately 6K expert-annotated pairs over 1.4K videos, supporting pair-wise and point-wise reward-model evaluation. Across modern video generators, our results expose a persistent gap between visual plausibility and world reasoning: videos can look convincing while failing dynamics, causality, or information preservation. We will release our benchmarks and evaluation toolkit to support community research on genuinely world-aware video generation at https://github.com/UniX-AI-Lab/WorldReasonBench/.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 23 of its 31 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

23 of 31 references.

References · 23

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  7. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  8. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  9. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  10. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  11. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  12. 2025Video models are zero-shot learners and reasonerscited by 220
11 more
  1. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
  2. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
  3. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  4. 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 122
  5. 2025VideoScore2: Think before You Score in Generative Video Evaluationcited by 40
  6. 2026A Very Big Video Reasoning Suitecited by 34
  7. 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Modelscited by 22
  8. 2025VideoEval-Pro: Robust and Realistic Long Video Understanding Evaluationcited by 21
  9. 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmarkcited by 19
  10. 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 13
  11. 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025WorldModelBench: Judging Video Generation Models As World Models
  2. 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
  3. 2026PAWBench: How Far Are We from Probabilistically Aligned World Modeling?
  4. 2026HappyWorld-Bench
  5. 2026StateCraft: Augmenting Video World Models with Abstract-State Reasoning
  6. 2026Nano World Models: A Minimalist Implementation of Future Video Prediction
  7. 2026World Action Models: A Survey
  8. 2026Video-Arena: A Scalable Agentic Video Benchmark for Spatiotemporal Capability