mlsanityData to 7 Oct 2026

HorizonDrive: Self-Corrective Autoregressive World Model for Long-horizon Driving Simulation

arXiv 2605.11596 ↗First posted 12 May 2026cs.CVcited by 3

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Closed-loop driving simulation requires real-time interaction beyond short offline clips, pushing current driving world models toward autoregressive (AR) rollout. Existing AR distillation approaches typically rely on frame sinks or student-side degradation training. The former transfers poorly to driving due to fast ego-motion and rapid scene changes, while the latter remains bounded by the teacher's single-pass output length and thus provides only a limited supervision horizon. A natural question is: can the teacher itself be extended via AR rollout to provide unbounded-horizon supervision at bounded memory cost? The key difficulty is that a standard teacher drifts under its own predictions, contaminating the supervision it provides. Our key insight is to make the teacher rollout-capable, ensuring reliable supervision from its own AR rollouts. This is instantiated as HorizonDrive, an anti-drifting training-and-distillation framework for AR driving simulation. First, scheduled rollout recovery (SRR) trains the base model to reconstruct ground-truth future clips from prediction-corrupted histories, yielding a teacher that remains stable across long AR rollouts. Second, the rollout-capable teacher is extended via AR rollout, providing long-horizon distribution-matching supervision under bounded memory, while a short-window student aligns to it with teacher rollout DMD (TRD) for efficient real-time deployment. HorizonDrive natively supports minute-scale AR rollout under bounded memory; on nuScenes, HorizonDrive reduces FID by 52% and FVD by 37%, and lowers ARE and DTW by 21% and 9% relative to the strongest long-horizon streaming baselines, while remaining competitive with single-pass driving video generators.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 58 of its 61 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

58 of 61 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
  2. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
  3. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  4. 2024MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenes23 May
  5. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
  6. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
  7. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep

Other references · 51

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  10. 2023Consistency Modelscited by 1,778
  11. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  12. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
38 more
  1. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  2. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  3. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  4. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  5. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  6. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  7. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  8. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  9. 2025Mean Flows for One-step Generative Modelingcited by 524
  10. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
  11. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  12. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  13. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 209
  14. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
  15. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173
  16. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
  17. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
  18. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  19. 2024In-Context LoRA for Diffusion Transformerscited by 155
  20. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
  21. 2026Advancing Open-source World Modelscited by 144
  22. 2024Consistency Models Made Easycited by 140
  23. 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
  24. 2025One-Minute Video Generation with Test-Time Trainingcited by 100
  25. 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
  26. 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 90
  27. 2025Mixture of Contexts for Long Video Generationcited by 90
  28. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 86
  29. 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 81
  30. 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 80
  31. 2025LongCat-Video Technical Reportcited by 73
  32. 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 68
  33. 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
  34. 2025Captain Cinema: Towards Short Movie Generationcited by 48
  35. 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 45
  36. 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 38
  37. 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenescited by 34
  38. 2026Diversity-Preserved Distribution Matching Distillation for Fast Visual Synthesiscited by 20

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026FAR-Drive: Frame-AutoRegressive Video Generation in Closed-Loop Autonomous Driving
  2. 2025RoaD: Rollouts as Demonstrations for Closed-Loop Supervised Fine-Tuning of Autonomous Driving Policies
  3. 2026Toward Physically Consistent Driving Video World Models under Challenging Trajectories
  4. 2026Is Energy Guidance All You Need? Training-Free Norm Injection for Driving World Models
  5. 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
  6. 2026Orbis 2: A Hierarchical World Model for Driving
  7. 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedback
  8. 2026RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts