From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models
Not on the map. Why?
Abstract (arXiv)
Video generation has advanced to produce visually compelling and temporally coherent results. Yet, whether these models can genuinely think with video--executing symbolic rules, respecting physical laws, and pursuing intentional goals--remains an open question. Existing benchmarks only partially address this, often conflating visual quality with cognitive correctness. We introduce VWG-Bench (Video World Generalist Benchmark), a comprehensive benchmark spanning 9 reasoning dimensions and 38 fine-grained tasks. To enable precise diagnosis, we design a three-level VLM-as-Judge protocol that independently assesses video-level fluency, task-level rule adherence, and sample-level goal realization. Evaluations of leading models reveal a striking gap: while models achieve strong rendering scores, they consistently fail on logic-heavy and rule-constrained tasks. To address this, we propose Vid-PRE (Video Prompt Reasoner and Enhancer), a model-agnostic prompt rewriter that offloads the cognitive burden of reasoning to a dedicated VLM. Trained via reinforcement learning with purely text-based rewards, Vid-PRE produces concise, constraint-aware prompts without the instability of video-level reward signals. Experiments show that Vid-PRE yields substantial reasoning improvements across multiple generators without architectural modifications. Together, VWG-Bench and Vid-PRE offer a rigorous diagnostic lens and a scalable path toward true think-with-video capabilities. All data and code are publicly available at https://huggingface.co/datasets/KlingTeam/VWG-Bench.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 45 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
40 of 45 references.
References · 40
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
28 more
- 2023Faithful Chain-of-Thought Reasoningcited by 285
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
- 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 94
- 2024Sora as a World Model? A Complete Survey on Text-to-Video Generationcited by 53
- 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Modelscited by 43
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmarkcited by 41
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 41
- 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoningcited by 36
- 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoningcited by 34
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 27
- 2024Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLMcited by 22
- 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Taskscited by 22
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Modelscited by 22
- 2025The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generationcited by 21
- 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmarkcited by 19
- 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Modelscited by 18
- 2025InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPOcited by 15
- 2025Survey of Video Diffusion Models: Foundations, Implementations, and Applicationscited by 14
- 2025Dr.V: A Hierarchical Perception-Temporal-Cognition Framework to Diagnose Video Hallucination by Fine-grained Spatial-Temporal Groundingcited by 13
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 12
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluationcited by 11
- 2026RISE-Video: Can Video Generators Decode Implicit World Rules?cited by 10
- 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models
- 2025Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoning
- 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generation
- 2026CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Models
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization
- 2025VR-Thinker: Boosting Video Reward Models through Thinking-with-Image Reasoning
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning
- 2026A Very Big Video Reasoning Suite