mlsanityData to 7 Oct 2026

DriveLaW:Unifying Planning and Video Generation in a Latent Driving World

arXiv 2512.23421 ↗First posted 29 Dec 2025cs.CVcited by 43

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

World models have become crucial for autonomous driving, as they learn how scenarios evolve over time to address the long-tail challenges of the real world. However, current approaches relegate world models to limited roles: they operate within ostensibly unified architectures that still keep world prediction and motion planning as decoupled processes. To bridge this gap, we propose DriveLaW, a novel paradigm that unifies video generation and motion planning. By directly injecting the latent representation from its video generator into the planner, DriveLaW ensures inherent consistency between high-fidelity future generation and reliable trajectory planning. Specifically, DriveLaW consists of two core components: DriveLaW-Video, our powerful world model that generates high-fidelity forecasting with expressive latent representations, and DriveLaW-Act, a diffusion planner that generates consistent and reliable trajectories from the latent of DriveLaW-Video, with both components optimized by a three-stage progressive training strategy. The power of our unified paradigm is demonstrated by new state-of-the-art results across both tasks. DriveLaW not only advances video prediction significantly, surpassing best-performing work by 33.3% in FID and 1.8% in FVD, but also achieves a new record on the NAVSIM planning benchmark.

Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 79 of its 88 references that are in the map. First posted on arXiv 29 Dec 2025.

Builds on

79 of 88 references.

Closest ancestors · 22

Same direction, newest first

  1. 2025OmniNWM: Omniscient Driving Navigation World Models21 Oct
  2. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  3. 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
  4. 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun
  5. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
  6. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
  7. 2025MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous Driving20 Mar
  8. 2025VaViM and VaVAM: Autonomous Driving through Video Generative Modeling21 Feb
  9. 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT27 Dec
  10. 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
  11. 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec
  12. 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
10 more
  1. 2024Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generation3 Jun
  2. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  3. 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving7 May
  4. 2024GenAD: Generalized Predictive Model for Autonomous Driving14 Mar
  5. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
  6. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splatting2 Jan
  7. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
  8. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
  9. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
  10. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun

Other references · 57

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  10. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  12. 2019Root Mean Square Layer Normalizationcited by 1,425
38 more
  1. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  2. 2022Planning-oriented Autonomous Drivingcited by 1,068
  3. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  5. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
  6. 2024Genie: Generative Interactive Environmentscited by 706
  7. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  8. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  9. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
  10. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  11. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  12. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
  13. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  14. 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
  15. 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
  16. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  17. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  18. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
  19. 2025Video models are zero-shot learners and reasonerscited by 208
  20. 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 203
  21. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
  22. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  23. 2017Decomposing Motion and Content for Natural Video Sequence Predictioncited by 168
  24. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
  25. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
  26. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  27. 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidancecited by 138
  28. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
  29. 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
  30. 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
  31. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
  32. 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
  33. 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 90
  34. 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 80
  35. 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Drivingcited by 76
  36. 2024GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Controlcited by 76
  37. 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learningcited by 76
  38. 2023PyramidFlow: High-Resolution Defect Contrastive Localization using Pyramid Normalizing Flowcited by 74

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 43.

43 papers.

Sort:

By area:

  1. 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generationcited by 36
  2. 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Drivingcited by 27
  3. 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Drivingcited by 26
  4. 2026DriveVA: Video Action Models are Zero-Shot Driverscited by 19
  5. 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planningcited by 17
  6. 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
  7. 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
  8. 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Drivingcited by 10
  9. 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 10
  10. 2026RAD-2: Scaling Reinforcement Learning in a Generator-Discriminator Frameworkcited by 7
  11. 2026Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negativescited by 6
  12. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
31 more
  1. 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Drivingcited by 6
  2. 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
  3. 2026Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Drivingcited by 5
  4. 2026UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generationcited by 5
  5. 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Drivingcited by 5
  6. 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challengescited by 3
  7. 2026Toward Physically Consistent Driving Video World Models under Challenging Trajectoriescited by 3
  8. 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Drivingcited by 3
  9. 2026RISE: Adaptive Imagination for World Action Modelscited by 3
  10. 2026CRAFT: Counterfactual-to-Interactive Reinforcement Fine-Tuning for Driving Policiescited by 2
  11. 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Drivingcited by 2
  12. 2026GeoWorldAD: Geometry World Action Model for Autonomous Drivingcited by 2
  13. 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Drivingcited by 2
  14. 2026GeoWAM: Visual Geometry World Action Models for Autonomous Drivingcited by 2
  15. 2026An Open-Source Modular Benchmark for Diffusion-Based Motion Planning in Closed-Loop Autonomous Drivingcited by 1
  16. 2026Unified Driving Tokens: Representation- and Geometry-Guided Discrete Tokenizer for Driving World Models and Planningcited by 1
  17. 2026ReWorld: Representation Learning for World Action Modelscited by 1
  18. 2026Adaptive-WAM: Quality-Guided Early-Exit Planning from Intermediate Video-Diffusion Featurescited by 1
  19. 2026Stream Forcing: Constructing Unified Training Trajectory for Robust Streaming Video Generationcited by 1
  20. 2026World-Action Models for Robot Learning and Control: A Surveycited by 1
  21. 2026LiAuto-GeoX: Efficient Grounded Driving Transformercited by 0
  22. 2026Is Energy Guidance All You Need? Training-Free Norm Injection for Driving World Modelscited by 0
  23. 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
  24. 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Renderingcited by 0
  25. 2026USR-Drive: Unified Driving Scene Representation via Joint Denoising of 3D Gaussians and Boxescited by 0
  26. 2026DriveZero: End-to-End Driving Beyond Human Demonstrationscited by 0
  27. 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Explorationcited by 0
  28. 2026Relationally Grounded Latent World Models for Autonomous Drivingcited by 0
  29. 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environmentscited by 0
  30. 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Drivingcited by 0
  31. 2026World4Scorer: Outcome-Grounded World Modeling for Autonomous Drivingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
  2. 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
  3. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
  4. 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
  5. 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives
  6. 2025A Survey of World Models for Autonomous Driving
  7. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving
  8. 2026DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving