CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
On the map: World models → World models for autonomous driving
also in 2 more
Abstract (arXiv)
Vision-Language-Action (VLA) models have emerged as a promising paradigm for end-to-end autonomous driving. However, existing reasoning mechanisms still struggle to provide planning-oriented intermediate representations: textual Chain-of-Thought (CoT) fails to preserve continuous spatiotemporal structure, while latent world reasoning remains difficult to use as a direct condition for action generation. In this paper, we propose CoWorld-VLA, a multi-expert world reasoning framework for autonomous driving, where world representations serve as explicit conditions to guide action planning. CoWorld-VLA extracts complementary world information through multi-source supervision and encodes it into expert tokens within the VLA, thereby providing planner-accessible conditioning signals. Specifically, we construct four types of tokens: semantic interaction, geometric structure, dynamic evolution, and ego trajectory tokens, which respectively model interaction intent, spatial structure, future temporal dynamics, and behavioral goals. During action generation, CoWorld-VLA employs a diffusion-based hierarchical multi-expert fusion planner, which is coupled with scene context throughout the joint denoising process to generate continuous ego trajectories. Experiments on NAVSIM v1 & v2 demonstrate future-scene modeling capability and strong planning performance, including collision avoidance and trajectory accuracy. Ablation studies further validate the complementarity of expert tokens and their effectiveness as planning conditions for action generation. Code will be available at https://github.com/AFARI-Research/CoWorld-VLA.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 84 of its 84 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
84 of 84 references.
Closest ancestors · 22
Same direction, newest first
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving28 Mar
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation16 Mar
- 2026ResWorld: Temporal Residual World Model for End-to-End Autonomous Driving11 Feb
- 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving World29 Dec
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
- 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun
- 2025GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Control28 May
- 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoning6 Apr
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT27 Dec
10 more
- 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
- 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Driving30 May
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving7 May
- 2024GenAD: Generalized Predictive Model for Autonomous Driving14 Mar
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
- 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion2 Nov
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 62
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
38 more
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2024Genie: Generative Interactive Environmentscited by 706
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2023GPT-Driver: Learning to Drive with GPTcited by 344
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representationscited by 192
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2025Unified Vision-Language-Action Modelcited by 128
- 2024VLP: Vision Language Planning for Autonomous Drivingcited by 125
- 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
- 2025Latent Visual Reasoningcited by 99
- 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
- 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 90
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 86
- 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 85
- 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learningcited by 76
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 65
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026ChainFlow-VLA: Causal Flow Planning with Vision-Language Modelscited by 3
- 2026Robot-Factored World Models via Robot Renderingcited by 3
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Drivingcited by 2
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Drivingcited by 1
- 2026Multi-Agent Embodied Autonomous Driving (MAEAD): From V2X Information Exchange to Shared World Modelscited by 0
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Renderingcited by 0
- 2026Planning in the Backbone: DiffAdapterVLA for Native Continuous Trajectory Generation with Driving VLMscited by 0
- 2026ReDrive: Shaping Representations with World Modeling for End-to-End Drivingcited by 0
- 2026PhysWAM: Physically Consistent World Action Model for Autonomous Drivingcited by 0
- 2026VGGTWorld-VLA: Intent-Conditioned 3D World Evolution for Autonomous Drivingcited by 0
- 2026VGGTWorld-VLA: Intent-Conditioned 3D World Evolution for Autonomous Driving8 Oct 2026
- 2026PhysWAM: Physically Consistent World Action Model for Autonomous Driving29 Sep 2026
- 2026ReDrive: Shaping Representations with World Modeling for End-to-End Driving27 Sep 2026
- 2026Planning in the Backbone: DiffAdapterVLA for Native Continuous Trajectory Generation with Driving VLMs14 Sep 2026
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving21 Aug 2026
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering18 Aug 2026
- 2026Robot-Factored World Models via Robot Rendering24 Jul 2026
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving23 Jul 2026
- 2026Multi-Agent Embodied Autonomous Driving (MAEAD): From V2X Information Exchange to Shared World Models11 Jun 2026
- 2026ChainFlow-VLA: Causal Flow Planning with Vision-Language Models22 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Learning Vision-Language-Action World Models for Autonomous Driving
- 2025ColaVLA: Leveraging Cognitive Latent Reasoning for Hierarchical Parallel Trajectory Planning in Autonomous Driving
- 2026WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving
- 2026BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving
- 2026HiST-VLA: A Hierarchical Spatio-Temporal Vision-Language-Action Model for End-to-End Autonomous Driving
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future