mlsanityData to 14 Oct 2026

Video-Mirai: Autoregressive Video Diffusion Models Need Foresight

arXiv 2606.03971 ↗First posted 2 Jun 2026cs.CVcited by 8

On the map: Diffusion models → Video generation

Abstract (arXiv)

Causal video generators must predict from the past, but they need not learn only from it. In streaming autoregressive video diffusion, each emitted segment becomes a commitment that future segments must preserve. Standard training, however, only asks each causal state to explain the present. This creates what we call a representation-level planning gap: states that fit the current segment may discard identity, layout, and motion information needed for a consistent future. We introduce Video-Mirai, a training-only method that closes this gap without changing causal inference: the generator rolls out causally, a frozen foresight encoder reads the completed rollout non-causally, and a lightweight predictor distills the resulting stopped-gradient targets into causal states. Future frames supervise representations, never generator inputs. At inference, the encoder and predictor are discarded, leaving the original architecture, per-step FLOPs, and KV-cache behavior unchanged. Video-Mirai improves a strong Causal-Forcing baseline on 5-second VBench from 83.8 to 84.6 in terms of Total Score. On 30-second rollouts beyond the training horizon, subject consistency improves from 84.9 to 88.5 and background consistency from 90.2 to 91.9. Ablations identify future-conditioned targets as the key ingredient, and probes show that future frames become more decodable from current features. Causality should constrain inference, not representation supervision. Our study highlights that visual autoregressive models need foresight. Project page: https://y0uroy.github.io/Video-Mirai.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 40 of its 41 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

40 of 41 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation2 Feb
  2. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
  3. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion9 Jun
  4. 2025SkyReels-V2: Infinite-length Film Generative Model17 Apr
  5. 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
  6. 2024Autoregressive Video Generation without Vector Quantization18 Dec
  7. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Models10 Dec
  8. 2024Pyramidal Flow Matching for Efficient Video Generative Modeling8 Oct
  9. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  11. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Training19 May
  12. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
1 more
  1. 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models10 Mar

Other references · 27

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2022Flow Matching for Generative Modelingcited by 5,702
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2014FitNets: Hints for Thin Deep Netscited by 1,653
15 more
  1. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  2. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  3. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  4. 2024Genie: Generative Interactive Environmentscited by 747
  5. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  6. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  7. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  8. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  9. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  10. 2024Better & Faster Large Language Models via Multi-token Predictioncited by 360
  11. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
  12. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
  13. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  14. 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 225
  15. 2026Mirai: Autoregressive Visual Generation Needs Foresightcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Conditional Residual Prediction: Improving Autoregressive Video Diffusion without a Bidirectional Teacher
  2. 2026RepForcing: Representation-Space Initialization for Autoregressive Video Distillation
  3. 2026TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL
  4. 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusion
  5. 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
  6. 2026RAVEN: Real-time Autoregressive Video Extrapolation with Consistency-model GRPO
  7. 2026Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusion
  8. 2026The Past Frames the Future: Memory for Autoregressive Video Generation