mlsanityData to 7 Oct 2026

How Far Can 5,500 Hours of Driving Take You? A Scaling Law Analysis of Video Diffusion Models

arXiv 2608.28404 ↗First posted 28 Aug 2026cs.CVcited by 0

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

Video generation for autonomous driving cannot follow the web-scale route: driving data is expensive to collect, bound by privacy requirements, and cannot be scraped at will, so models must make the most of a fixed corpus. We present a systematic scaling-law study of video diffusion models trained from scratch on driving data: a family of models from 1M to 9B parameters, trained at different exposures on up to 5,500 hours of driving. Validation loss follows consistent power laws in both model size and training exposure, answering the questions that shape a training budget: whether compute is better spent on longer training or on a larger model, and whether more data is needed. Loss improves much faster with training exposure than with model size, making longer training the most effective way to improve a fixed model under limited compute. However, larger models continue to achieve lower asymptotic loss, so compute-optimal scaling still favors increasing model size when sufficient compute and data are available. Guided by these laws, we train a 9B-parameter model, to our knowledge the largest video diffusion model trained from scratch on driving data: it sets a new open-source state of the art for driving video generation, as measured on nuScenes. Our code and pretrained models are available at https://github.com/valeoai/VATIX. NATIX is separately releasing the underlying driving data in stages.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 35 of its 39 references that are in the map. First posted on arXiv 28 Aug 2026.

Builds on

35 of 39 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026MAD: Motion Appearance Decoupling for efficient Driving World Models14 Jan
  2. 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun

Other references · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2020Scaling Laws for Neural Language Modelscited by 6,411
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  8. 2022Flow Matching for Generative Modelingcited by 5,426
  9. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  11. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
21 more
  1. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  2. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  3. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  4. 2023Scaling Data-Constrained Language Modelscited by 391
  5. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
  6. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
  7. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 186
  8. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
  9. 2024GenAD: Generalized Predictive Model for Autonomous Drivingcited by 150
  10. 2024GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Controlcited by 76
  11. 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPTcited by 66
  12. 2025Diffusion Beats Autoregressive in Data-Constrained Settingscited by 61
  13. 2025Scaling Laws for Native Multimodal Modelscited by 47
  14. 2024Scaling Laws For Diffusion Transformerscited by 41
  15. 2025VaViM and VaVAM: Autonomous Driving through Video Generative Modelingcited by 34
  16. 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Surveycited by 29
  17. 2024Scaling Laws for Pre-training Agents and World Modelscited by 23
  18. 2024Towards Precise Scaling Laws for Video Diffusion Transformerscited by 20
  19. 2025Data Scaling Laws for End-to-End Autonomous Drivingcited by 14
  20. 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
  21. 2026OccAny: Generalized Unconstrained Urban 3D Occupancycited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Data Scaling Laws for Imitation Learning-Based End-to-End Autonomous Driving
  2. 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
  3. 2024Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generation
  4. 2026FAR-Drive: Frame-AutoRegressive Video Generation in Closed-Loop Autonomous Driving
  5. 2025Diffusion Models for Safety Validation of Autonomous Driving Systems
  6. 2022Flexible Diffusion Modeling of Long Videos
  7. 2022On the Choice of Data for Efficient Training and Validation of End-to-End Driving Models
  8. 2024InfinityDrive: Breaking Time Limits in Driving World Models