mlsanityData to 7 Oct 2026

From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models

arXiv 2609.11242 ↗First posted 10 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Video generation has advanced to produce visually compelling and temporally coherent results. Yet, whether these models can genuinely think with video--executing symbolic rules, respecting physical laws, and pursuing intentional goals--remains an open question. Existing benchmarks only partially address this, often conflating visual quality with cognitive correctness. We introduce VWG-Bench (Video World Generalist Benchmark), a comprehensive benchmark spanning 9 reasoning dimensions and 38 fine-grained tasks. To enable precise diagnosis, we design a three-level VLM-as-Judge protocol that independently assesses video-level fluency, task-level rule adherence, and sample-level goal realization. Evaluations of leading models reveal a striking gap: while models achieve strong rendering scores, they consistently fail on logic-heavy and rule-constrained tasks. To address this, we propose Vid-PRE (Video Prompt Reasoner and Enhancer), a model-agnostic prompt rewriter that offloads the cognitive burden of reasoning to a dedicated VLM. Trained via reinforcement learning with purely text-based rewards, Vid-PRE produces concise, constraint-aware prompts without the instability of video-level reward signals. Experiments show that Vid-PRE yields substantial reasoning improvements across multiple generators without architectural modifications. Together, VWG-Bench and Vid-PRE offer a rigorous diagnostic lens and a scalable path toward true think-with-video capabilities. All data and code are publicly available at https://huggingface.co/datasets/KlingTeam/VWG-Bench.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 45 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

40 of 45 references.

References · 40

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  8. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  9. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  10. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  11. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  12. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
28 more
  1. 2023Faithful Chain-of-Thought Reasoningcited by 285
  2. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
  3. 2025Video models are zero-shot learners and reasonerscited by 208
  4. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
  5. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
  6. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  7. 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 94
  8. 2024Sora as a World Model? A Complete Survey on Text-to-Video Generationcited by 53
  9. 2025VLM4D: Towards Spatiotemporal Awareness in Vision Language Modelscited by 43
  10. 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmarkcited by 41
  11. 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 41
  12. 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoningcited by 36
  13. 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoningcited by 34
  14. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  15. 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 27
  16. 2024Prompt-A-Video: Prompt Your Video Diffusion Model via Preference-Aligned LLMcited by 22
  17. 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Taskscited by 22
  18. 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Modelscited by 22
  19. 2025The Devil is in the Prompts: Retrieval-Augmented Prompt Optimization for Text-to-Video Generationcited by 21
  20. 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmarkcited by 19
  21. 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Modelscited by 18
  22. 2025InfLVG: Reinforce Inference-Time Consistent Long Video Generation with GRPOcited by 15
  23. 2025Survey of Video Diffusion Models: Foundations, Implementations, and Applicationscited by 14
  24. 2025Dr.V: A Hierarchical Perception-Temporal-Cognition Framework to Diagnose Video Hallucination by Fine-grained Spatial-Temporal Groundingcited by 13
  25. 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 12
  26. 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluationcited by 11
  27. 2026RISE-Video: Can Video Generators Decode Implicit World Rules?cited by 10
  28. 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoningcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models
  2. 2025Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoning
  3. 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generation
  4. 2026CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Models
  5. 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization
  6. 2025VR-Thinker: Boosting Video Reward Models through Thinking-with-Image Reasoning
  7. 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning
  8. 2026A Very Big Video Reasoning Suite