mlsanityData to 7 Oct 2026

CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving

arXiv 2605.10426 ↗First posted 11 May 2026cs.CV cs.AIcited by 10

On the map: World models → World models for autonomous driving

also in 2 more
Abstract (arXiv)

Vision-Language-Action (VLA) models have emerged as a promising paradigm for end-to-end autonomous driving. However, existing reasoning mechanisms still struggle to provide planning-oriented intermediate representations: textual Chain-of-Thought (CoT) fails to preserve continuous spatiotemporal structure, while latent world reasoning remains difficult to use as a direct condition for action generation. In this paper, we propose CoWorld-VLA, a multi-expert world reasoning framework for autonomous driving, where world representations serve as explicit conditions to guide action planning. CoWorld-VLA extracts complementary world information through multi-source supervision and encodes it into expert tokens within the VLA, thereby providing planner-accessible conditioning signals. Specifically, we construct four types of tokens: semantic interaction, geometric structure, dynamic evolution, and ego trajectory tokens, which respectively model interaction intent, spatial structure, future temporal dynamics, and behavioral goals. During action generation, CoWorld-VLA employs a diffusion-based hierarchical multi-expert fusion planner, which is coupled with scene context throughout the joint denoising process to generate continuous ego trajectories. Experiments on NAVSIM v1 & v2 demonstrate future-scene modeling capability and strong planning performance, including collision avoidance and trajectory accuracy. Ablation studies further validate the complementarity of expert tokens and their effectiveness as planning conditions for action generation. Code will be available at https://github.com/AFARI-Research/CoWorld-VLA.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 84 of its 84 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

84 of 84 references.

Closest ancestors · 22

Same direction, newest first

  1. 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving28 Mar
  2. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation16 Mar
  3. 2026ResWorld: Temporal Residual World Model for End-to-End Autonomous Driving11 Feb
  4. 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving World29 Dec
  5. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  6. 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
  7. 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
  8. 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun
  9. 2025GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Control28 May
  10. 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning6 Apr
  11. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
  12. 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT27 Dec
10 more
  1. 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
  2. 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
  3. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Driving30 May
  4. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  5. 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving7 May
  6. 2024GenAD: Generalized Predictive Model for Autonomous Driving14 Mar
  7. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
  8. 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion2 Nov
  9. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
  10. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun

Other references · 62

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  9. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  10. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
  11. 2022Planning-oriented Autonomous Drivingcited by 1,068
  12. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
38 more
  1. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  2. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  3. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  4. 2024Genie: Generative Interactive Environmentscited by 706
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  6. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
  7. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  8. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  9. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  10. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  11. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
  12. 2023GPT-Driver: Learning to Drive with GPTcited by 344
  13. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
  14. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  15. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  16. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
  17. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
  18. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
  19. 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
  20. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  21. 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representationscited by 192
  22. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
  23. 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
  24. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
  25. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
  26. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  27. 2025Unified Vision-Language-Action Modelcited by 128
  28. 2024VLP: Vision Language Planning for Autonomous Drivingcited by 125
  29. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
  30. 2025Latent Visual Reasoningcited by 99
  31. 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
  32. 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 90
  33. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 86
  34. 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 85
  35. 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learningcited by 76
  36. 2025A Comprehensive Survey on World Models for Embodied AIcited by 65
  37. 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
  38. 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Vision-Language-Action World Models for Autonomous Driving
  2. 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
  3. 2026WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving
  4. 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving
  5. 2026BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving
  6. 2026HiST-VLA: A Hierarchical Spatio-Temporal Vision-Language-Action Model for End-to-End Autonomous Driving
  7. 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving
  8. 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future