DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving
On the map: World models → World models for autonomous driving
also in 2 more
Abstract (arXiv)
End-to-end (E2E) autonomous driving has recently attracted increasing interest in unifying Vision-Language-Action (VLA) with World Models to enhance decision-making and forward-looking imagination. However, existing methods fail to effectively unify future scene evolution and action planning within a single architecture due to inadequate sharing of latent states, limiting the impact of visual imagination on action decisions. To address this limitation, we propose DriveWorld-VLA, a novel framework that unifies world modeling and planning within a latent space by tightly integrating VLA and world models at the representation level, which enables the VLA planner to benefit directly from holistic scene-evolution modeling and reducing reliance on dense annotated supervision. Additionally, DriveWorld-VLA incorporates the latent states of the world model as core decision-making states for the VLA planner, facilitating the planner to assess how candidate actions impact future scene evolution. By conducting world modeling entirely in the latent space, DriveWorld-VLA supports controllable, action-conditioned imagination at the feature level, avoiding expensive pixel-level rollouts. Extensive open-loop and closed-loop evaluations demonstrate the effectiveness of DriveWorld-VLA, which achieves state-of-the-art performance with 91.3 PDMS on NAVSIMv1, 86.8 EPDMS on NAVSIMv2, and 0.16 3-second average collision rate on nuScenes. Code and models will be released in https://github.com/liulin815/DriveWorld-VLA.git.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 51 of its 57 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
51 of 57 references.
Closest ancestors · 19
Same direction, newest first
- 2025AD-R1: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving with Impartial World Models25 Nov
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
- 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
- 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Survey14 Feb
- 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generation24 Jan
- 2025A Survey of World Models for Autonomous Driving20 Jan
- 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
- 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Model14 Oct
- 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
7 more
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2024CarDreamer: Open-Source Learning Platform for World Model based Autonomous Driving15 May
- 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving7 May
- 2024World Models for Autonomous Driving: An Initial Survey5 Mar
- 2024GenAD: Generative End-to-End Autonomous Driving18 Feb
- 2023Visual Point Cloud Forecasting enables Scalable Autonomous Driving29 Dec
- 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion2 Nov
Other references · 32
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
20 more
- 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
- 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
- 2022Model-Based Imitation Learning for Urban Drivingcited by 149
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
- 2025Pseudo-Simulation for Autonomous Drivingcited by 141
- 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 93
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 85
- 2025Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Drivingcited by 84
- 2025ARTEMIS: Autoregressive End-to-End Trajectory Planning with Mixture of Experts for Autonomous Drivingcited by 66
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 53
- 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
- 2025Occ-LLM: Enhancing Autonomous Driving with Occupancy-Based Large Language Modelscited by 27
- 2025GuideFlow: Constraint-Guided Flow Matching for Planning in End-to-End Autonomous Drivingcited by 21
- 2025MapFusion: A Novel BEV Feature Fusion Network for Multi-modal Map Constructioncited by 20
- 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Drivingcited by 17
Built on by
Citing papers per year: 2026: 31.
31 papers.
Sort:
By area:
- 2026World Model for Robot Learning: A Comprehensive Surveycited by 42
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 17
- 2026SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Modelcited by 15
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
- 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Modelcited by 11
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanationcited by 9
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Drivingcited by 6
- 2026Auto-JEPA: A Latent World Model of Continuous Intent for End-to-End Autonomous Drivingcited by 4
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Drivingcited by 2
- 2026WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Drivingcited by 1
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Drivingcited by 1
19 more
- 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Modelcited by 0
- 2026Steins;Gate Drive: Semantic Safety Arbitration over Structured Futures for Latency-Decoupled LLM Planningcited by 0
- 2026Multi-Agent Embodied Autonomous Driving (MAEAD): From V2X Information Exchange to Shared World Modelscited by 0
- 2026GraphBEV++: Multi-Modal Feature Alignment for Autonomous Drivingcited by 0
- 2026MoRAL: Sensor-Grounded BEV Reasoning for Compact VLMs toward Edge-Oriented Autonomous Drivingcited by 0
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Drivingcited by 0
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semanticscited by 0
- 2026MomADv2: Reliable Temporal Memory for End-to-End Autonomous Drivingcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Drivingcited by 0
- 2026Relationally Grounded Latent World Models for Autonomous Drivingcited by 0
- 2026Sometimes You Gotta Run Before You Can Walk: Run-then-Walk Scheduling Strategy for VLM Autonomous Drivingcited by 0
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Drivingcited by 0
- 2026FocusDrive: Reasoning with Visual Focus for Autonomous Drivingcited by 0
- 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigationcited by 0
- 2026MomWorld: Momentum-Aware Latent World Model for Long-Horizon Autonomous Drivingcited by 0
- 2026PhysWAM: Physically Consistent World Action Model for Autonomous Drivingcited by 0
- 2026AffordDrive3D: Affordance-Aware World-Action Modeling with Spatial Understandingcited by 0
- 2026AffordDrive3D: Affordance-Aware World-Action Modeling with Spatial Understanding8 Oct 2026
- 2026PhysWAM: Physically Consistent World Action Model for Autonomous Driving29 Sep 2026
- 2026MomWorld: Momentum-Aware Latent World Model for Long-Horizon Autonomous Driving27 Sep 2026
- 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigation27 Sep 2026
- 2026FocusDrive: Reasoning with Visual Focus for Autonomous Driving27 Sep 2026
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving24 Sep 2026
- 2026Sometimes You Gotta Run Before You Can Walk: Run-then-Walk Scheduling Strategy for VLM Autonomous Driving22 Sep 2026
- 2026Relationally Grounded Latent World Models for Autonomous Driving21 Sep 2026
- 2026Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving3 Sep 2026
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026MomADv2: Reliable Temporal Memory for End-to-End Autonomous Driving24 Aug 2026
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving21 Aug 2026
19 more
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semantics18 Aug 2026
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Driving16 Aug 2026
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving4 Aug 2026
- 2026MoRAL: Sensor-Grounded BEV Reasoning for Compact VLMs toward Edge-Oriented Autonomous Driving3 Aug 2026
- 2026Auto-JEPA: A Latent World Model of Continuous Intent for End-to-End Autonomous Driving31 Jul 2026
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving23 Jul 2026
- 2026WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving9 Jul 2026
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving22 Jun 2026
- 2026GraphBEV++: Multi-Modal Feature Alignment for Autonomous Driving15 Jun 2026
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving15 Jun 2026
- 2026Multi-Agent Embodied Autonomous Driving (MAEAD): From V2X Information Exchange to Shared World Models11 Jun 2026
- 2026Steins;Gate Drive: Semantic Safety Arbitration over Structured Futures for Latency-Decoupled LLM Planning21 May 2026
- 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Model21 May 2026
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May 2026
- 2026World Model for Robot Learning: A Comprehensive Survey30 Apr 2026
- 2026SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Model21 Apr 2026
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanation20 Apr 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving2 Apr 2026
- 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Model13 Mar 2026
- 2026World Model for Robot Learning: A Comprehensive Surveycited by 42
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
- 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Modelcited by 11
- 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanationcited by 9
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Drivingcited by 6
- 2026Auto-JEPA: A Latent World Model of Continuous Intent for End-to-End Autonomous Drivingcited by 4
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Drivingcited by 2
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Drivingcited by 1
- 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Modelcited by 0
- 2026Multi-Agent Embodied Autonomous Driving (MAEAD): From V2X Information Exchange to Shared World Modelscited by 0
- 2026Relationally Grounded Latent World Models for Autonomous Drivingcited by 0
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Drivingcited by 0
12 most cited of 15 All 15 (JSON)
- 2026PhysWAM: Physically Consistent World Action Model for Autonomous Driving29 Sep 2026
- 2026MomWorld: Momentum-Aware Latent World Model for Long-Horizon Autonomous Driving27 Sep 2026
- 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigation27 Sep 2026
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving24 Sep 2026
- 2026Relationally Grounded Latent World Models for Autonomous Driving21 Sep 2026
- 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving21 Aug 2026
- 2026Auto-JEPA: A Latent World Model of Continuous Intent for End-to-End Autonomous Driving31 Jul 2026
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving23 Jul 2026
- 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Driving15 Jun 2026
- 2026Multi-Agent Embodied Autonomous Driving (MAEAD): From V2X Information Exchange to Shared World Models11 Jun 2026
- 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Model21 May 2026
- 2026DriveFuture: Future-Aware Latent World Models for Autonomous Driving10 May 2026
12 newest of 15 All 15 (JSON)
- 2026GraphBEV++: Multi-Modal Feature Alignment for Autonomous Drivingcited by 0
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Drivingcited by 0
- 2026MomADv2: Reliable Temporal Memory for End-to-End Autonomous Drivingcited by 0
- 2026Sometimes You Gotta Run Before You Can Walk: Run-then-Walk Scheduling Strategy for VLM Autonomous Drivingcited by 0
- 2026FocusDrive: Reasoning with Visual Focus for Autonomous Drivingcited by 0
- 2026FocusDrive: Reasoning with Visual Focus for Autonomous Driving27 Sep 2026
- 2026Sometimes You Gotta Run Before You Can Walk: Run-then-Walk Scheduling Strategy for VLM Autonomous Driving22 Sep 2026
- 2026MomADv2: Reliable Temporal Memory for End-to-End Autonomous Driving24 Aug 2026
- 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Driving16 Aug 2026
- 2026SUV: Future Scene Understanding as Video Generation for End-to-End Driving4 Aug 2026
- 2026GraphBEV++: Multi-Modal Feature Alignment for Autonomous Driving15 Jun 2026
- 2026SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Modelcited by 15
- 2026MoRAL: Sensor-Grounded BEV Reasoning for Compact VLMs toward Edge-Oriented Autonomous Drivingcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Drivingcited by 0
- 2026Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving3 Sep 2026
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026MoRAL: Sensor-Grounded BEV Reasoning for Compact VLMs toward Edge-Oriented Autonomous Driving3 Aug 2026
- 2026SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Model21 Apr 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 17
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
- 2026WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Drivingcited by 1
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semanticscited by 0
- 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semantics18 Aug 2026
- 2026WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving9 Jul 2026
- 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Driving22 Jun 2026
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving2 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Learning Vision-Language-Action World Models for Autonomous Driving
- 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving
- 2026ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving
- 2025DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Models
- 2026RAF-VLA: Representation Alignment with the Future for End-to-End Autonomous Driving
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving
- 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
- 2026WorldVLM: Combining World Model Forecasting and Vision-Language Reasoning