RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO
On the map: Diffusion models → Video generation
Abstract (arXiv)
Causal autoregressive video diffusion models support real-time streaming generation by extrapolating future chunks from previously generated content. Distilling such generators from high-fidelity bidirectional teachers yields competitive few-step models, yet a persistent gap between the history distributions encountered during training and those arising at inference constrains generation quality over long horizons. We introduce the Real-time Autoregressive Video Extrapolation Network (RAVEN), a training-time test framework that repacks each self rollout into an interleaved sequence of clean historical endpoints and noisy denoising states. This formulation aligns training attention with inference-time extrapolation and allows downstream chunk losses to supervise the history representations on which future predictions depend. We further propose Consistency-model Group Relative Policy Optimization (CM-GRPO), which reformulates a consistency sampling step as a conditional Gaussian transition and applies online Reinforcement Learning (RL) directly to this kernel, avoiding the Euler-Maruyama auxiliary process adopted in prior flow-model RL formulations. Experiments demonstrate that RAVEN surpasses recent causal video distillation baselines across quality, semantic, and dynamic degree evaluations, and that CM-GRPO provides further gains when combined with RAVEN.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 120 of its 126 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
120 of 126 references.
Closest ancestors · 27
Same direction, newest first
- 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generation22 Mar
- 2026Streaming Autoregressive Video Generation via Diagonal Distillation10 Mar
- 2026Train Short, Inference Long: Training-free Horizon Extension for Autoregressive Video Generation15 Feb
- 2026Pathwise Test-Time Correction for Autoregressive Long Video Generation5 Feb
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb
- 2026Past- and Future-Informed KV Cache Policy with Salience Estimation in Autoregressive Video Diffusion29 Jan
- 2025Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video Generation21 Dec
- 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resampling17 Dec
- 2025BAgger: Backwards Aggregation for Mitigating Drift in Autoregressive Video Diffusion Models12 Dec
- 2025Deep Forcing: Training-Free Long Video Generation with Deep Sink and Participative Compression4 Dec
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rollout25 Nov
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recycling10 Oct
15 more
- 2025Real-Time Motion-Controllable Autoregressive Video Diffusion9 Oct
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generation2 Oct
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer29 Sep
- 2025Macro-from-Micro Planning for High-Quality and Parallelized Autoregressive Long Video Generation5 Aug
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Models10 Jun
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2025SkyReels-V2: Infinite-length Film Generative Model17 Apr
- 2025Improving Video Generation with Human Feedback23 Jan
- 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
- 2024Autoregressive Video Generation without Vector Quantization18 Dec
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
- 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models10 Mar
Other references · 93
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2023Consistency Modelscited by 1,822
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
38 more
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2025EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Testcited by 331
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
- 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2025History-Guided Video Diffusioncited by 171
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 156
- 2024PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Acceleratorcited by 97
- 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Modelscited by 97
- 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 92
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 80
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 76
- 2024One-Step Diffusion Distillation through Score Implicit Matchingcited by 71
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2024Isambard-AI: a leadership class supercomputer optimised specifically for Artificial Intelligencecited by 62
- 2025BranchGRPO: Stable and Efficient GRPO with Structured Branching in Diffusion Modelscited by 61
- 2026Context Forcing: Consistent Autoregressive Video Generation with Long Contextcited by 59
- 2025Coefficients-Preserving Sampling for Reinforcement Learning with Flow Matchingcited by 56
- 2025GRPO-Guard: Mitigating Implicit Over-Optimization in Flow Matching via Regulated Clippingcited by 49
- 2024Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Stepcited by 47
- 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 45
50 most cited of 93 All 93 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffoldcited by 4
- 2026Flow-Map GRPO: Reinforcement Learning for Few-Step Flow-Map Generators via Anchored Stochastic Compositioncited by 3
- 2026Scaling Reinforcement Learning for Diffusion Models via Velocity Matchingcited by 3
- 2026DUET: A Diversity-Quality Duet of Distillation Experts for Two-Step Video Generationcited by 0
- 2026LeanGRPO: Eliminating Redundant Recomputation in Diffusion RLcited by 0
- 2026MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generationcited by 0
- 2026TGuide: Faster Autoregressive Video Diffusion via Historical Trajectory Guidancecited by 0
- 2026TGuide: Faster Autoregressive Video Diffusion via Historical Trajectory Guidance10 Oct 2026
- 2026MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generation1 Oct 2026
- 2026LeanGRPO: Eliminating Redundant Recomputation in Diffusion RL3 Sep 2026
- 2026Scaling Reinforcement Learning for Diffusion Models via Velocity Matching24 Aug 2026
- 2026DUET: A Diversity-Quality Duet of Distillation Experts for Two-Step Video Generation10 Aug 2026
- 2026Flow-Map GRPO: Reinforcement Learning for Few-Step Flow-Map Generators via Anchored Stochastic Composition1 Jul 2026
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold11 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL
- 2026Video-Mirai: Autoregressive Video Diffusion Models Need Foresight
- 2026Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teacher
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models
- 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
- 2026Self Gradient Forcing: Native Long Video Extrapolation
- 2026Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusion