VideoVerse: Does Your T2V Generator Have World Model Capability to Synthesize Videos?
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
The recent rapid advancement of Text-to-Video (T2V) generation technologies are engaging the trained models with more world model ability, making the existing benchmarks increasingly insufficient to evaluate state-of-the-art T2V models. First, current evaluation dimensions, such as per-frame aesthetic quality and temporal consistency, are no longer able to differentiate state-of-the-art T2V models. Second, event-level temporal causality-an essential property that differentiates videos from other modalities-remains largely unexplored. Third, existing benchmarks lack a systematic assessment of world knowledge, which are essential capabilities for building world models. To address these issues, we introduce VideoVerse, a comprehensive benchmark focusing on evaluating whether the current T2V model could understand complex temporal causality and world knowledge to synthesize videos. We collect representative videos across diverse domains and extract their event-level descriptions with inherent temporal causality, which are then rewritten into text-to-video prompts by independent annotators. For each prompt, we design ten evaluation dimensions covering dynamic and static properties, resulting in 300 prompts, 815 events, and 793 evaluation questions. Consequently, a human preference-aligned QA-based evaluation pipeline is developed by using modern vision-language models to systematically benchmark leading open- and closed-source T2V systems, revealing the current gap between T2V models and desired world modeling abilities.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 36 of its 38 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
36 of 38 references.
Closest ancestors · 7
Same direction, newest first
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Models20 May
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
- 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
Other references · 29
- 2016Improved Techniques for Training GANscited by 2,938
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2017Dense-Captioning Events in Videoscited by 789
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
17 more
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 124
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
- 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 53
- 2024MagicVideo-V2: Multi-Stage High-Aesthetic Video Generationcited by 48
- 2025Captain Cinema: Towards Short Movie Generationcited by 48
- 2022Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creationcited by 47
- 2024Sora Generates Videos with Stunning Geometrical Consistencycited by 31
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 28
- 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generationcited by 18
- 2024Is this Generated Person Existed in Real-world? Fine-grained Detecting and Calibrating Abnormal Human-bodycited by 12
- 2024Neuro-Symbolic Evaluation of Text-to-Video Models using Formal Verificationcited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025SeqBench: Benchmarking Sequential Narrative Generation in Text-to-Video Models
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generation
- 2025UI2V-Bench: An Understanding-based Image-to-video Generation Benchmark
- 2024Towards A Better Metric for Text-to-Video Generation
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generation
- 2026RISE-Video: Can Video Generators Decode Implicit World Rules?
- 2025PhyDetEx: Detecting and Explaining the Physical Plausibility of T2V Models
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics