DriveLaW:Unifying Planning and Video Generation in a Latent Driving World
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
World models have become crucial for autonomous driving, as they learn how scenarios evolve over time to address the long-tail challenges of the real world. However, current approaches relegate world models to limited roles: they operate within ostensibly unified architectures that still keep world prediction and motion planning as decoupled processes. To bridge this gap, we propose DriveLaW, a novel paradigm that unifies video generation and motion planning. By directly injecting the latent representation from its video generator into the planner, DriveLaW ensures inherent consistency between high-fidelity future generation and reliable trajectory planning. Specifically, DriveLaW consists of two core components: DriveLaW-Video, our powerful world model that generates high-fidelity forecasting with expressive latent representations, and DriveLaW-Act, a diffusion planner that generates consistent and reliable trajectories from the latent of DriveLaW-Video, with both components optimized by a three-stage progressive training strategy. The power of our unified paradigm is demonstrated by new state-of-the-art results across both tasks. DriveLaW not only advances video prediction significantly, surpassing best-performing work by 33.3% in FID and 1.8% in FVD, but also achieves a new record on the NAVSIM planning benchmark.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 79 of its 88 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
79 of 88 references.
Closest ancestors · 22
Same direction, newest first
- 2025OmniNWM: Omniscient Driving Navigation World Models21 Oct
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
- 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
- 2025MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous Driving20 Mar
- 2025VaViM and VaVAM: Autonomous Driving through Video Generative Modeling21 Feb
- 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT27 Dec
- 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec
- 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
10 more
- 2024Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generation3 Jun
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving7 May
- 2024GenAD: Generalized Predictive Model for Autonomous Driving14 Mar
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splatting2 Jan
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 57
- 2017Attention Is All You Needcited by 59,932
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2019Root Mean Square Layer Normalizationcited by 1,425
38 more
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2024Genie: Generative Interactive Environmentscited by 706
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2022MapTR: Structured Modeling and Learning for Online Vectorized HD Map Constructioncited by 311
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2022Flexible Diffusion Modeling of Long Videoscited by 294
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 203
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2017Decomposing Motion and Content for Natural Video Sequence Predictioncited by 168
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidancecited by 138
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
- 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
- 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
- 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
- 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 90
- 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Modelscited by 80
- 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Drivingcited by 76
- 2024GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Controlcited by 76
- 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learningcited by 76
- 2023PyramidFlow: High-Resolution Defect Contrastive Localization using Pyramid Normalizing Flowcited by 74
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 43.
43 papers.
Sort:
By area:
- 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generationcited by 36
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Drivingcited by 27
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Drivingcited by 26
- 2026DriveVA: Video Action Models are Zero-Shot Driverscited by 19
- 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planningcited by 17
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Drivingcited by 10
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 10
- 2026RAD-2: Scaling Reinforcement Learning in a Generator-Discriminator Frameworkcited by 7
- 2026Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negativescited by 6
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
31 more
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Drivingcited by 6
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
- 2026Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Drivingcited by 5
- 2026UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generationcited by 5
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Drivingcited by 5
- 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challengescited by 3
- 2026Toward Physically Consistent Driving Video World Models under Challenging Trajectoriescited by 3
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Drivingcited by 3
- 2026RISE: Adaptive Imagination for World Action Modelscited by 3
- 2026CRAFT: Counterfactual-to-Interactive Reinforcement Fine-Tuning for Driving Policiescited by 2
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Drivingcited by 2
- 2026GeoWorldAD: Geometry World Action Model for Autonomous Drivingcited by 2
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Drivingcited by 2
- 2026GeoWAM: Visual Geometry World Action Models for Autonomous Drivingcited by 2
- 2026An Open-Source Modular Benchmark for Diffusion-Based Motion Planning in Closed-Loop Autonomous Drivingcited by 1
- 2026Unified Driving Tokens: Representation- and Geometry-Guided Discrete Tokenizer for Driving World Models and Planningcited by 1
- 2026ReWorld: Representation Learning for World Action Modelscited by 1
- 2026Adaptive-WAM: Quality-Guided Early-Exit Planning from Intermediate Video-Diffusion Featurescited by 1
- 2026Stream Forcing: Constructing Unified Training Trajectory for Robust Streaming Video Generationcited by 1
- 2026World-Action Models for Robot Learning and Control: A Surveycited by 1
- 2026LiAuto-GeoX: Efficient Grounded Driving Transformercited by 0
- 2026Is Energy Guidance All You Need? Training-Free Norm Injection for Driving World Modelscited by 0
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Renderingcited by 0
- 2026USR-Drive: Unified Driving Scene Representation via Joint Denoising of 3D Gaussians and Boxescited by 0
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrationscited by 0
- 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Explorationcited by 0
- 2026Relationally Grounded Latent World Models for Autonomous Drivingcited by 0
- 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environmentscited by 0
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Drivingcited by 0
- 2026World4Scorer: Outcome-Grounded World Modeling for Autonomous Drivingcited by 0
- 2026World4Scorer: Outcome-Grounded World Modeling for Autonomous Driving29 Sep 2026
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving24 Sep 2026
- 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environments22 Sep 2026
- 2026Relationally Grounded Latent World Models for Autonomous Driving21 Sep 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Exploration8 Sep 2026
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrations5 Sep 2026
- 2026GeoWAM: Visual Geometry World Action Models for Autonomous Driving24 Aug 2026
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving21 Aug 2026
- 2026RISE: Adaptive Imagination for World Action Models20 Aug 2026
- 2026USR-Drive: Unified Driving Scene Representation via Joint Denoising of 3D Gaussians and Boxes19 Aug 2026
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering18 Aug 2026
31 more
- 2026Stream Forcing: Constructing Unified Training Trajectory for Robust Streaming Video Generation11 Aug 2026
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving7 Aug 2026
- 2026Adaptive-WAM: Quality-Guided Early-Exit Planning from Intermediate Video-Diffusion Features6 Aug 2026
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving4 Aug 2026
- 2026GeoWorldAD: Geometry World Action Model for Autonomous Driving20 Jul 2026
- 2026Is Energy Guidance All You Need? Training-Free Norm Injection for Driving World Models12 Jul 2026
- 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation6 Jul 2026
- 2026UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generation6 Jul 2026
- 2026ReWorld: Representation Learning for World Action Models25 Jun 2026
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving15 Jun 2026
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigation14 Jun 2026
- 2026LiAuto-GeoX: Efficient Grounded Driving Transformer4 Jun 2026
- 2026Unified Driving Tokens: Representation- and Geometry-Guided Discrete Tokenizer for Driving World Models and Planning1 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026IDOL: Inverse-Dynamics-Guided Future Prediction for End-to-End Autonomous Driving29 May 2026
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Driving20 May 2026
- 2026Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negatives19 May 2026
- 2026Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Driving18 May 2026
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoning14 May 2026
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving11 May 2026
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May 2026
- 2026CRAFT: Counterfactual-to-Interactive Reinforcement Fine-Tuning for Driving Policies6 May 2026
- 2026RAD-2: Scaling Reinforcement Learning in a Generator-Discriminator Framework16 Apr 2026
- 2026DriveVA: Video Action Models are Zero-Shot Drivers5 Apr 2026
- 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planning2 Apr 2026
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms30 Mar 2026
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Driving25 Mar 2026
- 2026Toward Physically Consistent Driving Video World Models under Challenging Trajectories25 Mar 2026
- 2026Latent World Models for Automated Driving: A Unified Taxonomy, Evaluation Framework, and Open Challenges10 Mar 2026
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving2 Mar 2026
- 2026An Open-Source Modular Benchmark for Diffusion-Based Motion Planning in Closed-Loop Autonomous Driving1 Mar 2026
- 2026Latent-WAM: Latent World Action Modeling for End-to-End Autonomous Drivingcited by 27
- 2026DriveVA: Video Action Models are Zero-Shot Driverscited by 19
- 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planningcited by 17
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
- 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Drivingcited by 10
- 2026Metis: A Generalizable and Efficient World-Action Model for Autonomous Driving and Urban Navigationcited by 10
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 6
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Drivingcited by 6
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
- 2026Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Drivingcited by 5
- 2026UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generationcited by 5
12 most cited of 30 All 30 (JSON)
- 2026World4Scorer: Outcome-Grounded World Modeling for Autonomous Driving29 Sep 2026
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving24 Sep 2026
- 2026Relationally Grounded Latent World Models for Autonomous Driving21 Sep 2026
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
- 2026Valerant: An Automatic Navigable Game Map Generator via Action-Conditioned World Model Exploration8 Sep 2026
- 2026GeoWAM: Visual Geometry World Action Models for Autonomous Driving24 Aug 2026
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving21 Aug 2026
- 2026RISE: Adaptive Imagination for World Action Models20 Aug 2026
- 2026Stream Forcing: Constructing Unified Training Trajectory for Robust Streaming Video Generation11 Aug 2026
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving7 Aug 2026
- 2026Adaptive-WAM: Quality-Guided Early-Exit Planning from Intermediate Video-Diffusion Features6 Aug 2026
- 2026GeoWorldAD: Geometry World Action Model for Autonomous Driving20 Jul 2026
12 newest of 30 All 30 (JSON)
- 2026Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negativescited by 6
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Drivingcited by 3
- 2026CRAFT: Counterfactual-to-Interactive Reinforcement Fine-Tuning for Driving Policiescited by 2
- 2026An Open-Source Modular Benchmark for Diffusion-Based Motion Planning in Closed-Loop Autonomous Drivingcited by 1
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrationscited by 0
- 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environmentscited by 0
- 2026NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environments22 Sep 2026
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrations5 Sep 2026
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving4 Aug 2026
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Driving20 May 2026
- 2026Beyond Imitation: Learning Safe End-to-End Autonomous Driving from Hard Negatives19 May 2026
- 2026CRAFT: Counterfactual-to-Interactive Reinforcement Fine-Tuning for Driving Policies6 May 2026
- 2026An Open-Source Modular Benchmark for Diffusion-Based Motion Planning in Closed-Loop Autonomous Driving1 Mar 2026
- 2026RAD-2: Scaling Reinforcement Learning in a Generator-Discriminator Frameworkcited by 7
- 2026LiAuto-GeoX: Efficient Grounded Driving Transformercited by 0
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Renderingcited by 0
- 2026USR-Drive: Unified Driving Scene Representation via Joint Denoising of 3D Gaussians and Boxescited by 0
- 2026USR-Drive: Unified Driving Scene Representation via Joint Denoising of 3D Gaussians and Boxes19 Aug 2026
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering18 Aug 2026
- 2026LiAuto-GeoX: Efficient Grounded Driving Transformer4 Jun 2026
- 2026RAD-2: Scaling Reinforcement Learning in a Generator-Discriminator Framework16 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
- 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
- 2025Trends in Motion Prediction Toward Deployable and Generalizable Autonomy: A Revisit and Perspectives
- 2025A Survey of World Models for Autonomous Driving
- 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving
- 2026DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving