Video-Mirai: Autoregressive Video Diffusion Models Need Foresight
On the map: Diffusion models → Video generation
Abstract (arXiv)
Causal video generators must predict from the past, but they need not learn only from it. In streaming autoregressive video diffusion, each emitted segment becomes a commitment that future segments must preserve. Standard training, however, only asks each causal state to explain the present. This creates what we call a representation-level planning gap: states that fit the current segment may discard identity, layout, and motion information needed for a consistent future. We introduce Video-Mirai, a training-only method that closes this gap without changing causal inference: the generator rolls out causally, a frozen foresight encoder reads the completed rollout non-causally, and a lightweight predictor distills the resulting stopped-gradient targets into causal states. Future frames supervise representations, never generator inputs. At inference, the encoder and predictor are discarded, leaving the original architecture, per-step FLOPs, and KV-cache behavior unchanged. Video-Mirai improves a strong Causal-Forcing baseline on 5-second VBench from 83.8 to 84.6 in terms of Total Score. On 30-second rollouts beyond the training horizon, subject consistency improves from 84.9 to 88.5 and background consistency from 90.2 to 91.9. Ablations identify future-conditioned targets as the key ingredient, and probes show that future frames become more decodable from current features. Causality should constrain inference, not representation supervision. Our study highlights that visual autoregressive models need foresight. Project page: https://y0uroy.github.io/Video-Mirai.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 40 of its 41 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
40 of 41 references.
Closest ancestors · 13
Same direction, newest first
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
- 2025SkyReels-V2: Infinite-length Film Generative Model17 Apr
- 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
- 2024Autoregressive Video Generation without Vector Quantization18 Dec
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
- 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Training19 May
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
1 more
Other references · 27
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
15 more
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2024Better & Faster Large Language Models via Multi-token Predictioncited by 360
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 225
- 2026Mirai: Autoregressive Visual Generation Needs Foresightcited by 2
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Self Gradient Forcing: Native Long Video Extrapolationcited by 17
- 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generationcited by 0
- 2026Future Video Generation Better Aligns with the Human Visual Cortex than Observed Videocited by 0
- 2026ProAR: Learning Prospective Reasoning with Autoregressive Video Modelscited by 0
- 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generationcited by 0
- 2026Connected Self Forcing: Beyond Local Learning in Video Autoregressioncited by 0
- 2026Adversarial Gradient Forcing for Robust Few-Step Autoregressive Video Generationcited by 0
- 2026Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusioncited by 0
- 2026Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusion10 Oct 2026
- 2026Adversarial Gradient Forcing for Robust Few-Step Autoregressive Video Generation10 Oct 2026
- 2026Connected Self Forcing: Beyond Local Learning in Video Autoregression8 Oct 2026
- 2026SGF+: Decoupling Gradient Flows for Autoregressive Video Generation7 Oct 2026
- 2026ProAR: Learning Prospective Reasoning with Autoregressive Video Models2 Oct 2026
- 2026Future Video Generation Better Aligns with the Human Visual Cortex than Observed Video30 Sep 2026
- 2026ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation24 Sep 2026
- 2026Self Gradient Forcing: Native Long Video Extrapolation22 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teacher
- 2026RepForcing: Representation-Space Initialization for Autoregressive Video Distillation
- 2026TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL
- 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusion
- 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
- 2026RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO
- 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusion
- 2026The Past Frames the Future: Memory for Autoregressive Video Generation