DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving
On the map: World models → World models for autonomous driving
also in 2 more
Abstract (arXiv)
Pretrained foundation models have become an important basis for end-to-end autonomous driving. In contrast to vision-language models pretrained primarily on static image-text pairs, video generative models capture temporal dynamics and motion priors that are naturally suited for driving. We present DriveWAM, a driving world-action model that adapts a pretrained video diffusion transformer into an autoregressive video-action policy. DriveWAM organizes video and action streams into a unified temporal token sequence and trains them under a joint flow-matching objective, preserving the pretrained video-generation architecture while adapting its large-scale video priors to action generation. To incorporate high-level scene understanding, we introduce scene-evolving driving guidance, where a frozen VLM produces chunk-specific semantic intent to guide video-action generation. To keep long-horizon rollout bounded, we further introduce selective KV memory, which maintains bounded modality-aware video and action memory pools through relevance-redundancy cache selection at inference time. Experiments on NAVSIM and the PhysicalAI-Autonomous-Vehicles benchmark show that DriveWAM achieves strong planning performance, and a data-scaling study from 4k to 100k driving clips further confirms the scaling potential of world-action modeling for end-to-end autonomous driving.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 58 of its 63 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
58 of 63 references.
Closest ancestors · 9
Same direction, newest first
- 2026X-World: Controllable Ego-Centric Multi-Camera World Models for Scalable End-to-End Driving20 Mar
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation16 Mar
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
- 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning6 Apr
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2025VaViM and VaVAM: Autonomous Driving through Video Generative Modeling21 Feb
- 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
- 2024GenAD: Generalized Predictive Model for Autonomous Driving14 Mar
Other references · 49
- 2023Visual Instruction Tuningcited by 7,792
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Neural Discrete Representation Learningcited by 4,650
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
37 more
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2026World Action Models are Zero-shot Policiescited by 411
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
- 2026Causal World Modeling for Robot Controlcited by 289
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 204
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2024FIFO-Diffusion: Generating Infinite Videos from Text without Trainingcited by 134
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 129
- 2022MoVQ: Modulating Quantized Vectors for High-Fidelity Image Generationcited by 125
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 103
- 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 100
- 2025Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutationcited by 100
- 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 85
- 2025LangCoop: Collaborative Driving with Languagecited by 25
- 2026Flow caching for autoregressive video generationcited by 19
- 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planningcited by 17
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026World Action Models: A Surveycited by 10
- 2026Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Drivingcited by 8
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Drivingcited by 5
- 2026Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learningcited by 3
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Drivingcited by 2
- 2026GeoWAM: Visual Geometry World Action Models for Autonomous Drivingcited by 2
- 2026Diffusion Transformer World-Action Model for AV Scene Predictioncited by 0
- 2026MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Drivingcited by 0
- 2026DriveReferee: Geometric Safety Verdicts Need Not Be Learned for Driving World-Action Modelscited by 0
- 2026SlackDrive: Reclaiming Runtime Slack for Adaptive Driving Inferencecited by 0
- 2026PhysWAM: Physically Consistent World Action Model for Autonomous Drivingcited by 0
- 2026AffordDrive3D: Affordance-Aware World-Action Modeling with Spatial Understandingcited by 0
- 2026AffordDrive3D: Affordance-Aware World-Action Modeling with Spatial Understanding8 Oct 2026
- 2026PhysWAM: Physically Consistent World Action Model for Autonomous Driving29 Sep 2026
- 2026SlackDrive: Reclaiming Runtime Slack for Adaptive Driving Inference23 Sep 2026
- 2026DriveReferee: Geometric Safety Verdicts Need Not Be Learned for Driving World-Action Models19 Sep 2026
- 2026MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Driving17 Sep 2026
- 2026Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving31 Aug 2026
- 2026GeoWAM: Visual Geometry World Action Models for Autonomous Driving24 Aug 2026
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving21 Aug 2026
- 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Driving7 Aug 2026
- 2026World Action Models: A Survey18 Jun 2026
- 2026Diffusion Transformer World-Action Model for AV Scene Prediction11 Jun 2026
- 2026Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learning4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
- 2026UNIVERSE: Unified Video Action Models for Autonomous Driving with Flexible Mask-Modulated Modality Generation
- 2026DriveVA: Video Action Models are Zero-Shot Drivers
- 2026FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving
- 2026BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving
- 2026SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving
- 2026ForgeDrive: Bidirectional Cross-Conditioning for Unified Visual-Action Generation in Autonomous Driving