RISE-Video: Can Video Generators Decode Implicit World Rules?
Not on the map. Why?
Abstract (arXiv)
While generative video models have achieved remarkable visual fidelity, their capacity to internalize and reason over implicit world rules remains a critical yet under-explored frontier. To bridge this gap, we present RISE-Video, a pioneering reasoning-oriented benchmark for Text-Image-to-Video (TI2V) synthesis that shifts the evaluative focus from surface-level aesthetics to deep cognitive reasoning. RISE-Video comprises 467 meticulously human-annotated samples spanning eight rigorous categories, providing a structured testbed for probing model intelligence across diverse dimensions, ranging from commonsense and spatial dynamics to specialized subject domains. Our framework introduces a multi-dimensional evaluation protocol consisting of four metrics: textitReasoning Alignment, textitTemporal Consistency, textitPhysical Rationality, and textitVisual Quality. To further support scalable evaluation, we propose an automated pipeline leveraging Large Multimodal Models (LMMs) to emulate human-centric assessment. Extensive experiments on 11 state-of-the-art TI2V models reveal pervasive deficiencies in simulating complex scenarios under implicit constraints, offering critical insights for the advancement of future world-simulating generative models.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 31 of its 41 references that are in the map. First posted on arXiv 5 Feb 2026.
Builds on
31 of 41 references.
References · 31
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2016Improved Techniques for Training GANscited by 2,938
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
19 more
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 167
- 2025Do generative video models understand physical principles?cited by 151
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2023Video-Bench: A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Modelscited by 107
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 74
- 2024Evaluation of Text-to-Video Generation Models: A Dynamics Perspectivecited by 66
- 2024Towards A Better Metric for Text-to-Video Generationcited by 50
- 2024TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generationcited by 42
- 2024TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Modelscited by 25
- 2025Step-Video-TI2V Technical Report: A State-of-the-Art Text-Driven Image-to-Video Generation Modelcited by 25
- 2025UI2V-Bench: An Understanding-based Image-to-video Generation Benchmarkcited by 10
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Demystifying Video Reasoningcited by 12
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?cited by 4
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 4
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 2
- 2026Edit Spillover as a Probe: Do Image Editing Models Implicitly Understand World Relations?cited by 1
- 2026SemComp-Bench: Benchmarking Semantic Task Completion in Video Generationcited by 1
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Modelscited by 0
- 2026V-ICAL Bench: Evaluating Video In-Context Learning for Multimodal Agents in Interactive Environmentscited by 0
- 2026Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Modelcited by 0
- 2026Reasoning-Informed Visual Editingcited by 0
- 2026Reasoning-Informed Visual Editing8 Oct 2026
- 2026Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model16 Sep 2026
- 2026V-ICAL Bench: Evaluating Video In-Context Learning for Multimodal Agents in Interactive Environments14 Sep 2026
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models10 Sep 2026
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning26 Aug 2026
- 2026SemComp-Bench: Benchmarking Semantic Task Completion in Video Generation18 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026WorldOlympiad: Can Your World Model Survive a Triathlon?9 Jun 2026
- 2026Edit Spillover as a Probe: Do Image Editing Models Implicitly Understand World Relations?18 Mar 2026
- 2026Demystifying Video Reasoning17 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models
- 2025T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generation
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark
- 2026How Far Are Video Models from True Multimodal Reasoning?
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models
- 2026Thinking in Video: Can Video Generators Really Reason About the Real World?