Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generation
Not on the map. Why?
Cited by 41 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Existing large-scale video generation models are computationally intensive, preventing adoption in real-time and interactive applications. In this work, we propose autoregressive adversarial post-training (AAPT) to transform a pre-trained latent video diffusion model into a real-time, interactive video generator. Our model autoregressively generates a latent frame at a time using a single neural function evaluation (1NFE). The model can stream the result to the user in real time and receive interactive responses as controls to generate the next latent frame. Unlike existing approaches, our method explores adversarial training as an effective paradigm for autoregressive generation. This not only allows us to design an architecture that is more efficient for one-step generation while fully utilizing the KV cache, but also enables training the model in a student-forcing manner that proves to be effective in reducing error accumulation during long video generation. Our experiments demonstrate that our 8B model achieves real-time, 24fps, streaming video generation at 736x416 resolution on a single H100, or 1280x720 on 8xH100 up to a minute long (1440 frames). Visit our research website at https://seaweed-apt.com/2
Key facts. Cited by 90 papers in the map (data through 14 Oct 2026). Builds on 111 of its 124 references that are in the map. First posted on arXiv 11 Jun 2025.
Builds on
111 of 124 references.
References · 111
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
38 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023Consistency Modelscited by 1,822
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2023Adversarial Diffusion Distillationcited by 759
- 2024Genie: Generative Interactive Environmentscited by 747
- 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 717
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2018Which Training Methods for GANs do actually Converge?cited by 679
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 519
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
50 most cited of 111 All 111 (JSON)
Built on by
Citing papers per year: 2025: 36; 2026: 54.
90 papers.
Sort:
By area:
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
- 2026Advancing Open-source World Modelscited by 154
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
- 2025Dynamic Chunking for End-to-End Hierarchical Sequence Modelingcited by 72
38 more
- 2026Context Forcing: Consistent Autoregressive Video Generation with Long Contextcited by 59
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 56
- 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
- 2026Infinite Worlds with Versatile Interactionscited by 48
- 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolutioncited by 43
- 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 32
- 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 32
- 2026Transition Matching Distillation for Fast Video Generationcited by 30
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
- 2025Pack and Force Your Memory: Long-form and Consistent Video Generationcited by 29
- 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillationcited by 26
- 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 25
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Modelscited by 25
- 2025Phased DMD: Few-step Distribution Matching Distillation via Score Matching within Subintervalscited by 24
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 22
- 2025LoViC: Efficient Long Video Generation with Context Compressioncited by 19
- 2025X-Streamer: Unified Human World Modeling with Audiovisual Interactioncited by 18
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoisingcited by 15
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 15
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Playerscited by 15
- 2026Code World Model: Coding Agent as World Braincited by 14
- 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latentscited by 13
- 20253D Scene Prompting for Scene-Consistent Camera-Controllable Video Generationcited by 13
- 2026Salt: Self-Consistent Distribution Matching with Cache-Aware Training for Fast Video Generationcited by 13
- 2025Adversarial Flow Modelscited by 12
- 2026Mode Seeking meets Mean Seeking for Fast Long Video Generationcited by 12
- 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Videocited by 10
- 2025Real-Time Motion-Controllable Autoregressive Video Diffusioncited by 9
- 2025EgoEdit: Dataset, Real-Time Streaming Model, and Benchmark for Egocentric Video Editingcited by 8
- 2026S2DiT: Sandwich Diffusion Transformer for Mobile Streaming Video Generationcited by 7
- 2026Evolution of Video Generative Foundationscited by 7
- 2026Efficient Video Diffusion Models: Advancements and Challengescited by 7
- 2025Block Cascading: Training Free Acceleration of Block-Causal Video Modelscited by 6
- 2025SemanticGen: Video Generation in Semantic Spacecited by 6
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamicscited by 6
- 2025Streaming Drag-Oriented Interactive Video Manipulation: Drag Anything, Anytime!cited by 5
50 most cited of 90 All 90 (JSON)
- 2026StreamErase: Towards Ultra-Fast Streaming Video Erasing14 Oct 2026
- 2026RepForcing: Representation-Space Initialization for Autoregressive Video Distillation14 Oct 2026
- 2026TGuide: Faster Autoregressive Video Diffusion via Historical Trajectory Guidance10 Oct 2026
- 2026Adversarial Gradient Forcing for Robust Few-Step Autoregressive Video Generation10 Oct 2026
- 2026AgentGarten: Code Worlds for Evolving Agents8 Oct 2026
- 2026Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teacher8 Oct 2026
- 2026Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation2 Oct 2026
- 2026Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation2 Oct 2026
- 2026DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation1 Oct 2026
- 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillation30 Sep 2026
- 2026Self-Aligned Forcing: Streaming Video Diffusion with Differentiable Noisy History29 Sep 2026
- 2026ReCaVSR: One-Step Streaming Diffusion Video Super-Resolution with Recycled Latents and Learned Cache Routing29 Sep 2026
38 more
- 2026Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generation29 Sep 2026
- 2026From Scores to Samples: Elastic Forcing for Autoregressive Video Generation28 Sep 2026
- 2026UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillation26 Sep 2026
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation18 Sep 2026
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation10 Sep 2026
- 2026Code World Model: Coding Agent as World Brain26 Aug 2026
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models14 Aug 2026
- 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation13 Aug 2026
- 2026DUET: A Diversity-Quality Duet of Distillation Experts for Two-Step Video Generation10 Aug 2026
- 2026FlashDecoder: Real-Time Latent-to-Pixel Streaming Decoder with Transformers16 Jul 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun 2026
- 2026AAD-1: Asymmetric Adversarial Distillation for One-Step Autoregressive Video Generation2 Jun 2026
- 2026Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEs1 Jun 2026
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players27 May 2026
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generation22 May 2026
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generation18 May 2026
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation14 May 2026
- 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillation13 May 2026
- 2026Stream-R1: Reliability-Perplexity Aware Reward Distillation for Streaming Video Generation5 May 2026
- 2026Efficient Video Diffusion Models: Advancements and Challenges17 Apr 2026
- 2026TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation16 Apr 2026
- 2026Continuous Adversarial Flow Models13 Apr 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2026Salt: Self-Consistent Distribution Matching with Cache-Aware Training for Fast Video Generation3 Apr 2026
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms30 Mar 2026
- 2026SHIFT: Motion Alignment in Video Diffusion Models with Adversarial Hybrid Fine-Tuning18 Mar 2026
- 2026FlashMotion: Few-Step Controllable Video Generation with Trajectory Guidance12 Mar 2026
- 2026HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoising9 Mar 2026
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generation5 Mar 2026
- 2026CubeComposer: Spatio-Temporal Autoregressive 4K 360deg Video Generation from Perspective Video4 Mar 2026
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolution28 Feb 2026
- 2026Mode Seeking meets Mean Seeking for Fast Long Video Generation27 Feb 2026
- 2026Causality in Video Diffusers is Separable from Denoising10 Feb 2026
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb 2026
- 2026Context Forcing: Consistent Autoregressive Video Generation with Long Context5 Feb 2026
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb 2026
- 2026Advancing Open-source World Models28 Jan 2026
50 newest of 90 All 90 (JSON)
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generationcited by 56
- 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 52
- 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
- 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolutioncited by 43
- 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 32
- 2026Transition Matching Distillation for Fast Video Generationcited by 30
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 30
- 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillationcited by 26
- 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 25
12 most cited of 36 All 36 (JSON)
- 2026RepForcing: Representation-Space Initialization for Autoregressive Video Distillation14 Oct 2026
- 2026TGuide: Faster Autoregressive Video Diffusion via Historical Trajectory Guidance10 Oct 2026
- 2026Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teacher8 Oct 2026
- 2026DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation1 Oct 2026
- 2026Self-Aligned Forcing: Streaming Video Diffusion with Differentiable Noisy History29 Sep 2026
- 2026ReCaVSR: One-Step Streaming Diffusion Video Super-Resolution with Recycled Latents and Learned Cache Routing29 Sep 2026
- 2026UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillation26 Sep 2026
- 2026DUET: A Diversity-Quality Duet of Distillation Experts for Two-Step Video Generation10 Aug 2026
- 2026FlashDecoder: Real-Time Latent-to-Pixel Streaming Decoder with Transformers16 Jul 2026
- 2026Real-Time Generation of Streamable Talking Portrait Video with Reference-Guided Deep Compression VAEs1 Jun 2026
- 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generation18 May 2026
- 2026Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation14 May 2026
12 newest of 36 All 36 (JSON)
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 234
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
- 2026Advancing Open-source World Modelscited by 154
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 96
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Modelscited by 25
- 2025X-Streamer: Unified Human World Modeling with Audiovisual Interactioncited by 18
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Playerscited by 15
- 2026Code World Model: Coding Agent as World Braincited by 14
- 2026Evolution of Video Generative Foundationscited by 7
12 most cited of 18 All 18 (JSON)
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation18 Sep 2026
- 2026Code World Model: Coding Agent as World Brain26 Aug 2026
- 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models14 Aug 2026
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models24 Jun 2026
- 2026Gamma-World: Generative Multi-Agent World Modeling Beyond Two Players27 May 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms30 Mar 2026
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb 2026
- 2026Advancing Open-source World Models28 Jan 2026
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamics22 Jan 2026
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec 2025
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec 2025
12 newest of 18 All 18 (JSON)
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
- 2025Dynamic Chunking for End-to-End Hierarchical Sequence Modelingcited by 72
- 2026Context Forcing: Consistent Autoregressive Video Generation with Long Contextcited by 59
- 2026Infinite Worlds with Versatile Interactionscited by 48
- 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 32
- 2025Pack and Force Your Memory: Long-form and Consistent Video Generationcited by 29
- 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 22
- 2026HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoisingcited by 15
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 15
- 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latentscited by 13
- 20253D Scene Prompting for Scene-Consistent Camera-Controllable Video Generationcited by 13
12 most cited of 34 All 34 (JSON)
- 2026StreamErase: Towards Ultra-Fast Streaming Video Erasing14 Oct 2026
- 2026Adversarial Gradient Forcing for Robust Few-Step Autoregressive Video Generation10 Oct 2026
- 2026AgentGarten: Code Worlds for Evolving Agents8 Oct 2026
- 2026Weave Forcing: Compositional Memory Routing for Interactive Long Video Generation2 Oct 2026
- 2026Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation2 Oct 2026
- 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillation30 Sep 2026
- 2026Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generation29 Sep 2026
- 2026From Scores to Samples: Elastic Forcing for Autoregressive Video Generation28 Sep 2026
- 2026Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation10 Sep 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026AAD-1: Asymmetric Adversarial Distillation for One-Step Autoregressive Video Generation2 Jun 2026
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generation22 May 2026
12 newest of 34 All 34 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models
- 2025Towards One-step Causal Video Generation via Adversarial Self-Distillation
- 2025Generative Pre-trained Autoregressive Diffusion Transformer
- 2026On-Policy Adversarial Flow Distillation for Autoregressive Video Generation
- 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusion
- 2024Autoregressive Video Generation without Vector Quantization
- 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
- 2025LongLive: Real-time Interactive Long Video Generation