Stream Forcing: Constructing Unified Training Trajectory for Robust Streaming Video Generation
On the map: World models → Video-generation world models and simulators
also in 1 more
Abstract (arXiv)
Streaming video generation holds strong potential for world modeling, where future frames must be inferred online sequentially to form a continuous video stream. However, streaming video diffusion models introduce a fundamental train-inference mismatch: inference follows a specialized denoising order, whereas advanced training strategies typically require diverse noise-level configurations. To address this trade-off between train-inference consistency and training coverage, we reformulate the video diffusion sampling as a frame-indexed stochastic process over noise levels. Within this stochastic process space, we construct a continuous training trajectory along which the sampling schedule progressively evolves from independent sampling to inference-consistent sampling. We further introduce a joint calibration algorithm and a temporal correlative sampling algorithm to ensure trajectory smoothness and cross-frame correlation. Building on these designs, we propose Stream Forcing, a unified training framework for streaming video generation that balances training sufficiency and inference efficiency. Extensive experiments demonstrate that Stream Forcing significantly improves generation quality with a 36.6% FVD improvement on the UCF-101 benchmark. Furthermore, our method facilitates robust zero-shot extrapolation to long-horizon video generation with a 27.9% FVD improvement on the UCF-101 benchmark.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 32 of its 64 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
32 of 64 references.
Closest ancestors · 5
Same direction, newest first
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025MAGI-1: Autoregressive Video Generation at Scale19 May
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2021VideoGPT: Video Generation using VQ-VAE and Transformers20 Apr
Other references · 27
- 2018World Modelscited by 1,444
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 485
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 385
- 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2025History-Guided Video Diffusioncited by 165
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 142
15 more
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
- 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
- 2025Long Context Tuning for Video Generationcited by 110
- 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
- 2024Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharingcited by 70
- 2025Kling-Omni Technical Reportcited by 60
- 2024MarDini: Masked Autoregressive Diffusion for Video Generation at Scalecited by 49
- 2024ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformercited by 45
- 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving Worldcited by 43
- 2024Redefining Temporal Modeling in Video Diffusion: The Vectorized Timestep Approachcited by 18
- 2025TinyHistory: Lightweight Video History Embeddings via Two-Stage Context Learningcited by 13
- 2025ScalingNoise: Scaling Inference-Time Search for Generating Infinite Videoscited by 12
- 2026RAD-2: Scaling Reinforcement Learning in a Generator-Discriminator Frameworkcited by 7
- 2025MobileI2V: Fast and High-Resolution Image-to-Video on Mobile Devicescited by 4
- 2026FrameDiT: Diffusion Transformer with Matrix Attention for Efficient Video Generationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Ms. Forcing: Efficient Streaming Video Generation with Multi-Scale Patchification and Attention
- 2026Stream-T1: Test-Time Scaling for Streaming Video Generation
- 2026Rethinking Streaming Video Diffusion Model: Context, Execution, and Training
- 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model
- 2026Self-Aligned Forcing: Streaming Video Diffusion with Differentiable Noisy History
- 2026Equilibrium Forcing: Adaptive Video Generation Without Noise Conditioning
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillation
- 2025MotionStream: Real-Time Video Generation with Interactive Motion Controls