mlsanityData to 7 Oct 2026

DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving

arXiv 2602.06521 ↗First posted 6 Feb 2026cs.CV cs.ROcited by 31

On the map: World models → World models for autonomous driving

also in 2 more
Abstract (arXiv)

End-to-end (E2E) autonomous driving has recently attracted increasing interest in unifying Vision-Language-Action (VLA) with World Models to enhance decision-making and forward-looking imagination. However, existing methods fail to effectively unify future scene evolution and action planning within a single architecture due to inadequate sharing of latent states, limiting the impact of visual imagination on action decisions. To address this limitation, we propose DriveWorld-VLA, a novel framework that unifies world modeling and planning within a latent space by tightly integrating VLA and world models at the representation level, which enables the VLA planner to benefit directly from holistic scene-evolution modeling and reducing reliance on dense annotated supervision. Additionally, DriveWorld-VLA incorporates the latent states of the world model as core decision-making states for the VLA planner, facilitating the planner to assess how candidate actions impact future scene evolution. By conducting world modeling entirely in the latent space, DriveWorld-VLA supports controllable, action-conditioned imagination at the feature level, avoiding expensive pixel-level rollouts. Extensive open-loop and closed-loop evaluations demonstrate the effectiveness of DriveWorld-VLA, which achieves state-of-the-art performance with 91.3 PDMS on NAVSIMv1, 86.8 EPDMS on NAVSIMv2, and 0.16 3-second average collision rate on nuScenes. Code and models will be released in https://github.com/liulin815/DriveWorld-VLA.git.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 51 of its 57 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

51 of 57 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025AD-R1: Closed-Loop Reinforcement Learning for End-to-End Autonomous Driving with Impartial World Models25 Nov
  2. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  3. 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
  4. 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
  5. 2025ReSim: Reliable World Simulation for Autonomous Driving11 Jun
  6. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Model2 Apr
  7. 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Survey14 Feb
  8. 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generation24 Jan
  9. 2025A Survey of World Models for Autonomous Driving20 Jan
  10. 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformers24 Dec
  11. 2024DOME: Taming Diffusion Model into High-Fidelity Controllable Occupancy World Model14 Oct
  12. 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
7 more
  1. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  2. 2024CarDreamer: Open-Source Learning Platform for World Model based Autonomous Driving15 May
  3. 2024DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving7 May
  4. 2024World Models for Autonomous Driving: An Initial Survey5 Mar
  5. 2024GenAD: Generative End-to-End Autonomous Driving18 Feb
  6. 2023Visual Point Cloud Forecasting enables Scalable Autonomous Driving29 Dec
  7. 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion2 Nov

Other references · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  5. 2022Planning-oriented Autonomous Drivingcited by 1,068
  6. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  7. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  8. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 455
  9. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
  10. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 301
  11. 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
  12. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
20 more
  1. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
  2. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
  3. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
  4. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
  5. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
  6. 2022Model-Based Imitation Learning for Urban Drivingcited by 149
  7. 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
  8. 2025Pseudo-Simulation for Autonomous Drivingcited by 141
  9. 2025Hydra-MDP++: Advancing End-to-End Driving via Expert-Guided Hydra-Distillationcited by 93
  10. 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
  11. 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 85
  12. 2025Don't Shake the Wheel: Momentum-Aware Planning in End-to-End Autonomous Drivingcited by 84
  13. 2025ARTEMIS: Autoregressive End-to-End Trajectory Planning with Mixture of Experts for Autonomous Drivingcited by 66
  14. 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
  15. 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 53
  16. 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
  17. 2025Occ-LLM: Enhancing Autonomous Driving with Occupancy-Based Large Language Modelscited by 27
  18. 2025GuideFlow: Constraint-Guided Flow Matching for Planning in End-to-End Autonomous Drivingcited by 21
  19. 2025MapFusion: A Novel BEV Feature Fusion Network for Multi-modal Map Constructioncited by 20
  20. 2025DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Drivingcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 31.

31 papers.

Sort:

By area:

  1. 2026World Model for Robot Learning: A Comprehensive Surveycited by 42
  2. 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 17
  3. 2026SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Modelcited by 15
  4. 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
  5. 2026VGGT-World: Transforming VGGT into an Autoregressive Geometry World Modelcited by 11
  6. 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanationcited by 9
  7. 2026GraphWorld: Long-Horizon Planning with World Models for End-to-End Autonomous Drivingcited by 6
  8. 2026Auto-JEPA: A Latent World Model of Continuous Intent for End-to-End Autonomous Drivingcited by 4
  9. 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
  10. 2026WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Drivingcited by 2
  11. 2026WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Drivingcited by 1
  12. 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Drivingcited by 1
19 more
  1. 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Modelcited by 0
  2. 2026Steins;Gate Drive: Semantic Safety Arbitration over Structured Futures for Latency-Decoupled LLM Planningcited by 0
  3. 2026Multi-Agent Embodied Autonomous Driving (MAEAD): From V2X Information Exchange to Shared World Modelscited by 0
  4. 2026GraphBEV++: Multi-Modal Feature Alignment for Autonomous Drivingcited by 0
  5. 2026MoRAL: Sensor-Grounded BEV Reasoning for Compact VLMs toward Edge-Oriented Autonomous Drivingcited by 0
  6. 2026SUV: Future Scene Understanding as Video Generation for End-to-End Drivingcited by 0
  7. 2026Not All History Helps: Velocity-Aware Selective Memory for Long-Horizon End-to-End Autonomous Drivingcited by 0
  8. 2026Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semanticscited by 0
  9. 2026MomADv2: Reliable Temporal Memory for End-to-End Autonomous Drivingcited by 0
  10. 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
  11. 2026Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Drivingcited by 0
  12. 2026Relationally Grounded Latent World Models for Autonomous Drivingcited by 0
  13. 2026Sometimes You Gotta Run Before You Can Walk: Run-then-Walk Scheduling Strategy for VLM Autonomous Drivingcited by 0
  14. 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Drivingcited by 0
  15. 2026FocusDrive: Reasoning with Visual Focus for Autonomous Drivingcited by 0
  16. 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigationcited by 0
  17. 2026MomWorld: Momentum-Aware Latent World Model for Long-Horizon Autonomous Drivingcited by 0
  18. 2026PhysWAM: Physically Consistent World Action Model for Autonomous Drivingcited by 0
  19. 2026AffordDrive3D: Affordance-Aware World-Action Modeling with Spatial Understandingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Vision-Language-Action World Models for Autonomous Driving
  2. 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Driving
  3. 2026ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving
  4. 2025DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Models
  5. 2026RAF-VLA: Representation Alignment with the Future for End-to-End Autonomous Driving
  6. 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving
  7. 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving
  8. 2026WorldVLM: Combining World Model Forecasting and Vision-Language Reasoning