mlsanityData to 7 Oct 2026

WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving

arXiv 2607.08375 ↗First posted 9 Jul 2026cs.CV cs.AIcited by 1

On the map: Vision-language-action models → VLA for autonomous driving

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models have advanced end-to-end autonomous driving. However, existing methods either lack comprehensive world cognition or suffer from fragmented world foresight, inherently confining these models to reactive driving. To address this limitation, we propose WCog-VLA, a novel dual-level World-Cognitive VLA framework that successfully bridges semantic world forecasting with generative world evolution to achieve proactive autonomous driving. At the semantic level, WCog-VLA unifies world cognition and reasoning by incorporating 3D spatial perception and injecting agent tokens to capture the world dynamics, while concurrently enabling Game-theoretic Chain-of-Thought (Game-CoT) reasoning. At the generative level, we introduce the Aligned Decoupled Diffusion Transformer (ADDT) as a powerful generative world model that synthesizes physically-plausible joint multi-agent trajectories. Through scene representation alignment, ADDT reduces the number of denoising steps required and thus significantly accelerates inference. To facilitate strategic reasoning, we further construct a large-scale dataset featuring 85k Game-CoT annotations. Extensive experiments on the NAVSIM benchmark demonstrate that WCog-VLA achieves a State-Of-The-Art (SOTA) PDMS score of 92.9.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 59 of its 65 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

59 of 65 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
  2. 2025DrivePI: Spatial-aware 4D MLLM for Unified Autonomous Driving Understanding, Perception, Prediction and Planning14 Dec
  3. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct
  4. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  5. 2025Discrete Diffusion for Reflective Vision-Language-Action Models in Autonomous Driving24 Sep
  6. 2025IRL-VLA: Training an Vision-Language-Action Policy via Reward World Model7 Aug
  7. 2025A Survey on Vision-Language-Action Models for Autonomous Driving30 Jun
  8. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
  9. 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Models29 May
  10. 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Driving22 May
  11. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model30 Mar

Other references · 48

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  6. 2022Planning-oriented Autonomous Drivingcited by 1,068
  7. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
  8. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  9. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
  10. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  11. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  12. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
36 more
  1. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 365
  2. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
  3. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  4. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  5. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 258
  6. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
  7. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
  8. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  9. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  10. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
  11. 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
  12. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  13. 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
  14. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 145
  15. 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 144
  16. 2026Advancing Open-source World Modelscited by 144
  17. 2025Diffusion-Based Planning for Autonomous Driving with Flexible Guidancecited by 138
  18. 2025DDT: Decoupled Diffusion Transformercited by 100
  19. 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformerscited by 96
  20. 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Drivingcited by 93
  21. 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mambacited by 87
  22. 2024Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Modelscited by 75
  23. 2024Automated Evaluation of Large Vision-Language Models on Self-driving Corner Casescited by 75
  24. 2025ARTEMIS: Autoregressive End-to-End Trajectory Planning with Mixture of Experts for Autonomous Drivingcited by 66
  25. 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
  26. 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
  27. 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Trainingcited by 57
  28. 2024VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Drivingcited by 49
  29. 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
  30. 2025iPad: Iterative Proposal-centric End-to-End Autonomous Drivingcited by 41
  31. 2025AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Drivingcited by 35
  32. 2026SGDrive: Scene-to-Goal Hierarchical World Cognition for Autonomous Drivingcited by 34
  33. 2020Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approachcited by 30
  34. 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Drivingcited by 20
  35. 2025Percept-WAM: Perception-Enhanced World-Awareness-Action Model for Robust End-to-End Autonomous Drivingcited by 9
  36. 2026SparseOccVLA: Bridging Occupancy and Vision-Language Models via Sparse Queries for Unified 4D Scene Understanding and Planningcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Vision-Language-Action World Models for Autonomous Driving
  2. 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
  3. 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving
  4. 2026WorldVLM: Combining World Model Forecasting and Vision-Language Reasoning
  5. 2026X-Mind: Efficient Visual Chain-of-Thought via Predictive World Model for End-to-End Driving
  6. 2026BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving
  7. 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving
  8. 2026ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving