HorizonDrive: Self-Corrective Autoregressive World Model for Long-horizon Driving Simulation
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Closed-loop driving simulation requires real-time interaction beyond short offline clips, pushing current driving world models toward autoregressive (AR) rollout. Existing AR distillation approaches typically rely on frame sinks or student-side degradation training. The former transfers poorly to driving due to fast ego-motion and rapid scene changes, while the latter remains bounded by the teacher's single-pass output length and thus provides only a limited supervision horizon. A natural question is: can the teacher itself be extended via AR rollout to provide unbounded-horizon supervision at bounded memory cost? The key difficulty is that a standard teacher drifts under its own predictions, contaminating the supervision it provides. Our key insight is to make the teacher rollout-capable, ensuring reliable supervision from its own AR rollouts. This is instantiated as HorizonDrive, an anti-drifting training-and-distillation framework for AR driving simulation. First, scheduled rollout recovery (SRR) trains the base model to reconstruct ground-truth future clips from prediction-corrupted histories, yielding a teacher that remains stable across long AR rollouts. Second, the rollout-capable teacher is extended via AR rollout, providing long-horizon distribution-matching supervision under bounded memory, while a short-window student aligns to it with teacher rollout DMD (TRD) for efficient real-time deployment. HorizonDrive natively supports minute-scale AR rollout under bounded memory; on nuScenes, HorizonDrive reduces FID by 52% and FVD by 37%, and lowers ARE and DTW by 21% and 9% relative to the strongest long-horizon streaming baselines, while remaining competitive with single-pass driving video generators.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 58 of its 61 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
58 of 61 references.
Closest ancestors · 7
Same direction, newest first
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2024MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenes23 May
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
Other references · 51
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023Consistency Modelscited by 1,778
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
38 more
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Timecited by 209
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 173
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2024In-Context LoRA for Diffusion Transformerscited by 155
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
- 2026Advancing Open-source World Modelscited by 144
- 2024Consistency Models Made Easycited by 140
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
- 2025One-Minute Video Generation with Test-Time Trainingcited by 100
- 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
- 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 90
- 2025Mixture of Contexts for Long Video Generationcited by 90
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 86
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 81
- 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 80
- 2025LongCat-Video Technical Reportcited by 73
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 68
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
- 2025Captain Cinema: Towards Short Movie Generationcited by 48
- 2025End-to-End Training for Autoregressive Video Diffusion via Self-Resamplingcited by 45
- 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 38
- 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenescited by 34
- 2026Diversity-Preserved Distribution Matching Distillation for Fast Visual Synthesiscited by 20
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streamingcited by 1
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulationcited by 0
- 2026HelloWorld: Towards Practical Applications of Generative Driving World Modelscited by 0
- 2026HelloWorld: Towards Practical Applications of Generative Driving World Models24 Sep 2026
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation18 Sep 2026
- 2026M4World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streaming15 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026FAR-Drive: Frame-AutoRegressive Video Generation in Closed-Loop Autonomous Driving
- 2025RoaD: Rollouts as Demonstrations for Closed-Loop Supervised Fine-Tuning of Autonomous Driving Policies
- 2026Toward Physically Consistent Driving Video World Models under Challenging Trajectories
- 2026Is Energy Guidance All You Need? Training-Free Norm Injection for Driving World Models
- 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
- 2026Orbis 2: A Hierarchical World Model for Driving
- 2025Learning Through Retrospection: Improving Trajectory Prediction for Automated Driving with Error Feedback
- 2026RoXDrive: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving via Action-Faithful Rollouts