Video-as-Answer: Predict and Generate Next Video Event with Joint-GRPO
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
While language models have become impactful in many real-world applications, video generation remains largely confined to entertainment. Motivated by video's inherent capacity to demonstrate physical-world information that is difficult to convey through language alone (e.g., imagine teaching someone to tie a tie using only text), we identify an underutilized opportunity to extend video as a new answer modality for Next-Event Prediction (NEP), formalized as Video-Next-Event Prediction (VNEP). While the established NEP task takes a video with a procedural or predictive question as input to predict the next event in text, VNEP requires dynamic video responses. This shift from telling to showing unlocks more intuitive and customized answers for procedural learning and creative exploration. However, this task remains challenging for existing models, as it demands an understanding of multimodal input, instruction-conditioned reasoning, and the generation of video with visual and semantic consistency. To address this, we introduce VANS, a model that leverages reinforcement learning to align a Vision-Language Model (VLM) with a Video Diffusion Model (VDM) for VNEP. The core of VANS is our proposed Joint-GRPO that orchestrates the VLM and VDM to function as a unit. Driven by a shared reward on their respective output, it optimizes the VLM to produce captions that are both accurate and friendly to visualize, while guiding the VDM to generate videos that are faithful to these captions and the input visual context. To enable this learning, we craft VANS-Data-100K, a dedicated dataset for the VNEP task. Experiments on procedural and predictive benchmarks demonstrate that VANS achieves state-of-the-art performance in both video event prediction and visualization. Codes are released in https://github.com/KlingTeam/VANS.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 37 of its 55 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
37 of 55 references.
Closest ancestors · 10
Same direction, newest first
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning9 Jul
- 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning19 Jun
- 2025Fostering Video Reasoning via Next-Event Prediction28 May
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
- 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPO19 May
- 2025TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action2 May
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R131 Mar
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
Other references · 27
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Qwen Technical Reportcited by 3,344
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
- 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 130
15 more
- 2024Video as the New Language for Real-World Decision Makingcited by 87
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2020What is More Likely to Happen Next? Video-and-Language Future Event Predictioncited by 62
- 2025LLM Agents for Education: Advances and Applicationscited by 59
- 2025ARC-Hunyuan-Video-7B: Structured Video Comprehension of Real-World Shortscited by 41
- 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 40
- 2021Joint Multimedia Event Extraction from Video and Articlecited by 19
- 2025UniVid: The Open-Source Unified Video Modelcited by 19
- 2025HaploOmni: Unified Single Transformer for Multimodal Video Understanding and Generationcited by 13
- 2025UI2V-Bench: An Understanding-based Image-to-video Generation Benchmarkcited by 11
- 2025Video-GPT via Next Clip Diffusioncited by 8
- 2025MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoningcited by 8
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimizationcited by 8
- 2023Multiscale Video Pretraining for Long-Term Activity Forecastingcited by 6
- 2025Stitch-a-Demo: Video Demonstrations from Multistep Descriptionscited by 1
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimizationcited by 5
- 2026Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Predictioncited by 3
- 2026Advances in GRPO for Generation Models: A Surveycited by 2
- 2026LogiShot: Logically Coherent Cross-Shot Video Generationcited by 1
- 2026Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoningcited by 1
- 2026RiskCueBench: Benchmarking Anticipatory Reasoning from Early Risk Cues in Video-Language Modelscited by 0
- 2026Reward-Decomposed Reinforcement Learning for Immersive Video Role-Playingcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026FlowCred: Hierarchical Credit Assignment and Functional Coordination for Joint Text-to-Video Post-Trainingcited by 0
- 2026FlowCred: Hierarchical Credit Assignment and Functional Coordination for Joint Text-to-Video Post-Training13 Oct 2026
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoning16 Aug 2026
- 2026LogiShot: Logically Coherent Cross-Shot Video Generation9 Aug 2026
- 2026Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Prediction4 Jun 2026
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization1 Jun 2026
- 2026Reward-Decomposed Reinforcement Learning for Immersive Video Role-Playing6 May 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026RiskCueBench: Benchmarking Anticipatory Reasoning from Early Risk Cues in Video-Language Models6 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025What Happens Next? Next Scene Prediction with a Unified Video Model
- 2025Video-As-Prompt: Unified Semantic Control for Video Generation
- 2024AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Prediction
- 2025Enhancing Visual Planning with Auxiliary Tasks and Multi-token Prediction
- 2023VidCoM: Fast Video Comprehension through Large Language Models with Multimodal Tools
- 2023Video Language Planning
- 2026VR-JEPA: Learning Contrastive-State Latent Guidance for Generation-based Video Reasoning
- 2024VG-TVP: Multimodal Procedural Planning via Visually Grounded Text-Video Prompting