WAM-Diff: A Masked Diffusion VLA Framework with MoE and Online Reinforcement Learning for Autonomous Driving
On the map: Vision-language-action models → VLA for autonomous driving
also in 3 more
Abstract (arXiv)
End-to-end autonomous driving systems based on vision-language-action (VLA) models integrate multimodal sensor inputs and language instructions to generate planning and control signals. While autoregressive large language models and continuous diffusion policies are prevalent, the potential of discrete masked diffusion for trajectory generation remains largely unexplored. This paper presents WAM-Diff, a VLA framework that employs masked diffusion to iteratively refine a discrete sequence representing future ego-trajectories. Our approach features three key innovations: a systematic adaptation of masked diffusion for autonomous driving that supports flexible, non-causal decoding orders; scalable model capacity via a sparse MoE architecture trained jointly on motion prediction and driving-oriented visual question answering (VQA); and online reinforcement learning using Group Sequence Policy Optimization (GSPO) to optimize sequence-level driving rewards. Remarkably, our model achieves 91.0 PDMS on NAVSIM-v1 and 89.7 EPDMS on NAVSIM-v2, demonstrating the effectiveness of masked diffusion for autonomous driving. The approach provides a promising alternative to autoregressive and diffusion-based policies, supporting scenario-aware decoding strategies for trajectory generation. The code for this paper will be released publicly at: https://github.com/fudan-generative-vision/WAM-Diff
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 37 of its 66 references that are in the map. First posted on arXiv 6 Dec 2025.
Builds on
37 of 66 references.
Closest ancestors · 5
Same direction, newest first
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving24 Sep
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
- 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Driving22 May
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model30 Mar
Other references · 32
- 2025Qwen3 Technical Reportcited by 8,195
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025Large Language Diffusion Modelscited by 872
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 712
- 2025Dream 7B: Diffusion Large Language Modelscited by 515
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2023GPT-Driver: Learning to Drive with GPTcited by 344
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
20 more
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learningcited by 178
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
- 2025Pseudo-Simulation for Autonomous Drivingcited by 141
- 2024RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Modelcited by 91
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mambacited by 87
- 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulationcited by 87
- 2025ARTEMIS: Autoregressive End-to-End Trajectory Planning with Mixture of Experts for Autonomous Drivingcited by 66
- 2025Discrete Diffusion in Large Language and Multimodal Models: A Surveycited by 61
- 2025LLaDA-MoE: A Sparse MoE Diffusion Language Modelcited by 54
- 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
- 2024WiseAD: Knowledge Augmented End-to-End Autonomous Driving with Vision-Language Modelcited by 28
- 2025MoRE: Unlocking Scalability in Reinforcement Learning for Quadruped Vision-Language-Action Modelscited by 27
- 2025SafeAuto: Knowledge-Enhanced Safe Autonomous Driving with Multimodal Foundation Modelscited by 22
- 2024Is a 3D-Tokenized LLM the Key to Reliable Autonomous Driving?cited by 20
- 2025InsightDrive: Insight Scene Representation for End-to-End Autonomous Drivingcited by 14
- 2025ViLaD: A Large Vision Language Diffusion Framework for End-to-End Autonomous Drivingcited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 9.
10 papers.
- 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbonecited by 18
- 2026DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Drivingcited by 18
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 17
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Drivingcited by 3
- 2026Post-Training in End-to-End Autonomous Drivingcited by 2
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Drivingcited by 2
- 2026From Representational Complementarity to Dual Systems: Synergizing VLM and Vision-Only Backbones for End-to-End Drivingcited by 1
- 2026ASSCG: Just-Right Gating over Chattering for Fast-Slow LLM Planning in Autonomous Drivingcited by 1
- 2026DriveStack-VLA: Render-Teacher Alignment for BEV-Based DeepStack Vision-Language-Action Modelcited by 0
- 2026ReDrive: Shaping Representations with World Modeling for End-to-End Drivingcited by 0
- 2026ReDrive: Shaping Representations with World Modeling for End-to-End Driving27 Sep 2026
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving21 Aug 2026
- 2026Post-Training in End-to-End Autonomous Driving9 Jul 2026
- 2026ASSCG: Just-Right Gating over Chattering for Fast-Slow LLM Planning in Autonomous Driving24 Jun 2026
- 2026DriveStack-VLA: Render-Teacher Alignment for BEV-Based DeepStack Vision-Language-Action Model23 Jun 2026
- 2026Distill to Think, Foresee to Act: Cognitive-Physical Reinforcement Learning for Autonomous Driving20 May 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving2 Apr 2026
- 2026DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Driving16 Feb 2026
- 2026From Representational Complementarity to Dual Systems: Synergizing VLM and Vision-Only Backbones for End-to-End Driving11 Feb 2026
- 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbone27 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026WAM-Diff2: Hierarchical AR-to-Diffusion Distillation for Highly Efficient Autonomous Driving VLA
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Driving
- 2025VDRive: Leveraging Reinforced VLA and Diffusion Policy for End-to-end Autonomous Driving
- 2026Efficient and Explainable End-to-End Autonomous Driving via Masked Vision-Language-Action Diffusion
- 2026Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Driving
- 2025dVLM-AD: Enhance Diffusion Vision-Language-Model for Driving via Controllable Reasoning
- 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving
- 2026DriveMA: Driving Vision-Language-Action Models with verifiable Meta-Actions