mlsanityData to 14 Oct 2026

BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving

arXiv 2608.12854 ↗First posted 13 Aug 2026cs.RO cs.AI cs.CVcited by 2

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Autonomous driving requires planning under both semantic constraints and predictive dynamics. Existing end-to-end driving approaches, however, typically emphasize only one side of this requirement: Vision-Language-Action (VLA) models exploit VLM priors for semantic reasoning, while World Action Models (WAMs) provide future-aware prediction through generative world modeling. This naturally motivates a unified planner that can leverage both semantic priors and predictive dynamics. However, we find that a naive combination through joint token-level attention suffers from an attention-allocation mismatch, where semantic shortcuts dominate the shared attention space and suppress predictive dynamics. Inspired by neuroscience evidence that complex behavior arises from coordination among functionally specialized systems, we propose BrainWAM, a structured action-space coordination framework that converts semantic reasoning and predictive world modeling into two specialized action-oriented pathways, and aligns them at the level of compact action representations. We further introduce an asynchronous rectified-flow inference strategy with decoupled video and action denoising, which shortens inference latency while preserving planning-relevant predictive context. BrainWAM reaches state-of-the-art performance on both NAVSIM v1 (89.5 PDMS) and NAVSIM v2 (89.6 EPDMS), consistently outperforming VLA-only or WAM-only methods, highlighting BrainWAM as a practical and promising direction for autonomous driving systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 19 of its 53 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

19 of 53 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Map-World: Masked Action planning and Path-Integral World Model for Autonomous Driving25 Nov
  2. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  3. 2023ADriver-I: A General World Model for Autonomous Driving22 Nov
  4. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
  5. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun

Other references · 14

  1. 2022Flow Matching for Generative Modelingcited by 5,702
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
  6. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  7. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  8. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 240
  9. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
  10. 2025Pseudo-Simulation for Autonomous Drivingcited by 150
  11. 2025Unified Vision-Language-Action Modelcited by 134
  12. 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 96
2 more
  1. 2026DriveDreamer-Policy: A Geometry-Grounded World-Action Model for Unified Generation and Planningcited by 17
  2. 2026DynVLA: Learning World Dynamics for Action Reasoning in Autonomous Drivingcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Vision-Language-Action World Models for Autonomous Driving
  2. 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
  3. 2026X-Mind: Efficient Visual Chain-of-Thought via Predictive World Model for End-to-End Driving
  4. 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
  5. 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
  6. 2026DriveWAM: Video Generative Priors Enable Scalable World-Action Modeling for Autonomous Driving
  7. 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
  8. 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving