mlsanityData to 14 Oct 2026

Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation

arXiv 2605.15141 ↗First posted 14 May 2026cs.CVcited by 56

On the map: Diffusion models → Video generation

Abstract (arXiv)

Real-time interactive video generation requires low-latency, streaming, and controllable rollout. Existing autoregressive (AR) diffusion distillation methods have achieved strong results in the chunk-wise 4-step regime by distilling bidirectional base models into few-step AR students, but they remain limited by coarse response granularity and non-negligible sampling latency. In this paper, we study a more aggressive setting: frame-wise autoregression with only 1--2 sampling steps. In this regime, we identify the initialization of a few-step AR student as the key bottleneck: existing strategies are either target-misaligned, incapable of few-step generation, or too costly to scale. We propose Causal Forcing++, a principled and scalable pipeline that uses causal consistency distillation (causal CD) for few-step AR initialization. The core idea is that causal CD learns the same AR-conditional flow map as causal ODE distillation, but obtains supervision from a single online teacher ODE step between adjacent timesteps, avoiding the need to precompute and store full PF-ODE trajectories. This makes the initialization both more efficient and easier to optimize. The resulting pipeline, ours, surpasses the SOTA 4-step chunk-wise Causal Forcing under the textitframe-wise 2-step setting by 0.1 in VBench Total, 0.3 in VBench Quality, and 0.335 in VisionReward, while reducing first-frame latency by 50% and Stage 2 training cost by ~4×. We further extend the pipeline to action-conditioned world model generation in the spirit of Genie3. Project Page: https://github.com/thu-ml/Causal-Forcing and https://github.com/shengshu-ai/minWM .

Key facts. Cited by 56 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 58 of its 63 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

58 of 63 references.

Closest ancestors · 18

Same direction, newest first

  1. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb
  2. 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resampling17 Dec
  3. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  4. 2025BAgger: Backwards Aggregation for Mitigating Drift in Autoregressive Video Diffusion Models12 Dec
  5. 2025UltraViCo: Breaking Extrapolation Limits in Video Diffusion Transformers25 Nov
  6. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generation2 Oct
  7. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
  8. 2025Radial Attention: O(nlog n) Sparse Attention with Energy Decay for Long Video Generation24 Jun
  9. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
  10. 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers21 Feb
  11. 2025Diffusion Adversarial Post-Training for One-Step Video Generation14 Jan
  12. 2024Autoregressive Video Generation without Vector Quantization18 Dec
6 more
  1. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
  2. 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  4. 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model22 Jun
  5. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Models7 May
  6. 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models10 Mar

Other references · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2023Consistency Modelscited by 1,822
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  9. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  10. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  11. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  12. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
28 more
  1. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  2. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  3. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  4. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  5. 2023Improved Techniques for Training Consistency Modelscited by 439
  6. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  7. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  8. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
  9. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  10. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  11. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 256
  12. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  13. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
  14. 2019Scaling Autoregressive Video Modelscited by 190
  15. 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
  16. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
  17. 2025Cameras as Relative Positional Encodingcited by 105
  18. 2025Autoregressive Adversarial Post-Training for Real-Time Interactive Video Generationcited by 90
  19. 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 86
  20. 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
  21. 2025Pack and Force Your Memory: Long-form and Consistent Video Generationcited by 29
  22. 2025StreamAvatar: Streaming Diffusion Models for Real-Time Interactive Human Avatarscited by 25
  23. 2026WorldCompass: Reinforcement Learning for Long-Horizon World Modelscited by 24
  24. 2023ControlVideo: Conditional Control for One-shot Text-driven Video Editing and Beyondcited by 22
  25. 2026Avatar Forcing: Real-Time Interactive Head Avatar Generation for Natural Conversationcited by 19
  26. 2025Towards One-step Causal Video Generation via Adversarial Self-Distillationcited by 15
  27. 2025Vidarc: Embodied Video Diffusion Model for Closed-loop Controlcited by 15
  28. 2025UltraImage: Rethinking Resolution Extrapolation in Image Diffusion Transformerscited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 56.

56 papers.

Sort:

By area:

  1. 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 40
  2. 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Modelscited by 25
  3. 2026minWM: A Full-Stack Open-Source Framework for Real-Time Interactive Video World Modelscited by 19
  4. 2026Self Gradient Forcing: Native Long Video Extrapolationcited by 17
  5. 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 15
  6. 2026SolarWM: Open Data and Scalable Training for Long-Horizon Video World Modelscited by 12
  7. 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memorycited by 9
  8. 2026BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregressioncited by 6
  9. 2026Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillationcited by 5
  10. 2026TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RLcited by 4
  11. 2026Vidu S1: A Real-Time Interactive Video Generation Modelcited by 4
  12. 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
38 more
  1. 2026DistillAlign: Coordinating Mode Covering and Mode Seeking in Autoregressive Video Distillationcited by 4
  2. 2026Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Controlcited by 4
  3. 2026WorldMind: Decoupled Game World Model for State-Aware NPC Behaviorcited by 3
  4. 2026RECAP-Forcing: Retaining Content Appearances for Long Video Generationcited by 3
  5. 2026Magpie: Real-Time World Renderer for Interactive Gamescited by 3
  6. 2026Astronex-World 1.0: Real-Time Interactive World Model Foundationcited by 3
  7. 2026ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Modelscited by 2
  8. 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editingcited by 2
  9. 2026Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generationcited by 2
  10. 2026Closing the Loop: Training-Free Revisit Consistency for Autoregressive Generative Renderingcited by 1
  11. 2026Do Video Generators Track the World Across Segments? A Benchmark and Method for World-State Reasoning in Video Continuationcited by 1
  12. 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editingcited by 1
  13. 2026WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memorycited by 1
  14. 2026GameDirector: Decoupling Gameplay Logic from Rendering for Player-Configurable Game World Modelscited by 1
  15. 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
  16. 2026DuoMatching: Joint-Marginal Distribution Matching for Few-Step Video Generationcited by 1
  17. 2026InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adaptercited by 0
  18. 2026LiveVVT: High-Fidelity Video Virtual Try-On in Real Timecited by 0
  19. 2026SNF-Bench: Separating Static Drift from Natural Flow in Long-Horizon Fixed-Camera Video Generationcited by 0
  20. 2026ActionSplice: In-Flight Action Editing for Interactive World Modelscited by 0
  21. 2026StrucPhysVideo: Learning Physical Dynamics from Structured Captions and Robot Actionscited by 0
  22. 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulationcited by 0
  23. 2026Streaming Video Editing with Easy Adaptationcited by 0
  24. 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generationcited by 0
  25. 2026OneFixer: High-Quality and Consistent One-Step Autoregressive 3DGS Refinement for Driving Scenescited by 0
  26. 2026UnStep: Training-Free Acceleration of Causal Video Diffusion with Fewer Steps Than Distillationcited by 0
  27. 2026LongTake: Learning to Sustain Dynamics in Long-Horizon Video Generationcited by 0
  28. 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generationcited by 0
  29. 2026Visualizing Distribution Coverage in Generative Diffusion Modelscited by 0
  30. 2026DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistencycited by 0
  31. 2026Enhancing Autoregressive Video Generation via Representation Adversarial Distillationcited by 0
  32. 2026Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generationcited by 0
  33. 2026Real-Time Joint Audio-Video Generation by Parallel Adapter Compositioncited by 0
  34. 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generationcited by 0
  35. 2026Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teachercited by 0
  36. 2026Connected Self Forcing: Beyond Local Learning in Video Autoregressioncited by 0
  37. 2026ForcingBooster: Adaptive Patch-wise Denoising for Fast Autoregressive Video Diffusioncited by 0
  38. 2026Adversarial Gradient Forcing for Robust Few-Step Autoregressive Video Generationcited by 0

50 most cited of 56 All 56 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
  2. 2026UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation
  3. 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusion
  4. 2026Streaming Autoregressive Video Generation via Diagonal Distillation
  5. 2026Glance Forcing: Making Bidirectional Diffusion Autoregressive at a Glance
  6. 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memory
  7. 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout
  8. 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model