mlsanityData to 14 Oct 2026

Glance Forcing: Making Bidirectional Diffusion Autoregressive at a Glance

arXiv 2610.20220 ↗First posted 14 Oct 2026cs.CVcited by 0

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Autoregressive generation underlies real-time, causal video synthesis and is the backbone of video world models. Today's dominant approach distills a bidirectional diffusion model into a causal few-step student, but existing pipelines make this conversion prohibitively expensive, requiring offline Probability Flow ODE} (PF-ODE) trajectories that cost tens of thousands of GPU-hours and terabytes of storage. We show it can be made dramatically more efficient. Pushing this efficiency to its extreme, we reduce trajectory supervision to a single sample, the strictest setting possible, and find that it causes severe quality collapse. We trace this to the teacher's trajectory geometry: the high-noise regime, governing semantic layout and motion, and the low-noise regime, governing fine texture exhibit fundamentally different curvature and optimization behavior, so a single monolithic student cannot jointly fit both, causing severe representation interference. Motivated by this, we propose Glance Forcing, a lightweight distillation framework that decouples the denoising trajectory into two complementary slow and fast experts, each guided by a tailored, stage-specific objective, while keeping the pretrained teacher entirely frozen. This decoupling further reveals a general mechanism underlying few-step distillation: PF-ODE distillation mainly straightens the few-step trajectory geometry, while the subsequent distribution-matching stage independently governs distributional quality. Using only one PF-ODE trajectory, Glance Forcing already surpasses the fully-trained state-of-the-art baseline, raising the VBench Total score from 84.04 to 84.22 while cutting trajectory-collection cost from thousands of GPU-hours to about one A100-GPU-hour, with markedly larger gains in dynamic degree, VisionReward, and instruction-following, and consistent preference from human raters over strong baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 30 of its 31 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

30 of 31 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
  2. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
  3. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  5. 2022Flow Matching for Generative Modeling6 Oct

Other references · 25

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  3. 2022Video Diffusion Modelscited by 2,305
  4. 2023Consistency Modelscited by 1,822
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  6. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  7. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  8. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  9. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  10. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  11. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  12. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
13 more
  1. 2023Improved Techniques for Training Consistency Modelscited by 439
  2. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
  3. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
  4. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  5. 2023Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Modelscited by 236
  6. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 229
  7. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
  8. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
  9. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
  10. 2024VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelscited by 131
  11. 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 86
  12. 2026Transition Matching Distillation for Fast Video Generationcited by 30
  13. 2026Streaming Autoregressive Video Generation via Diagonal Distillationcited by 18

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026In-Context Forcing: Uncovering Context Effects in Autoregressive Video Diffusion
  2. 2026Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout
  3. 2026Flex-Forcing: Towards a Unified Autoregressive and Bidirectional Video Diffusion Model
  4. 2026MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing
  5. 2026RepForcing: Representation-Space Initialization for Autoregressive Video Distillation
  6. 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
  7. 2026Self-Aligned Forcing: Streaming Video Diffusion with Differentiable Noisy History
  8. 2026UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation