mlsanityData to 7 Oct 2026

LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Model

arXiv 2605.22089 ↗First posted 21 May 2026cs.CV cs.AIcited by 0

On the map: World models → World models for autonomous driving

also in 2 more
Abstract (arXiv)

Vision-Language-Action (VLA) models have emerged as a promising framework for end-to-end autonomous driving. However, existing VLAs typically rely on sparse action supervision, which underutilizes their powerful scene understanding and reasoning capabilities. Recent attempts to incorporate dense visual supervision via world modeling often overemphasize pixel-level image reconstruction, neglecting semantically meaningful scene representation learning. In this work, we propose LVDrive, a Latent Visual representation enhanced VLA framework for autonomous driving. LVDrive introduces a future scene prediction task into the VLA paradigm, where future representations are learned entirely in a high-level latent space under auxiliary supervision from a pretrained vision backbone. Departing from inefficient autoregressive generation, we jointly model future scene and motion prediction within a unified embedding space, processed in a single forward pass to conduct the future-aware reasoning. We further design a two-stage trajectory decoding strategy that explicitly leverages the learned latent future representations to refine trajectory generation. Extensive experiments on the challenging Bench2Drive benchmark demonstrate that LVDrive achieves significant improvements in closed-loop driving performance, outperforming both action supervised methods and image-reconstruction-based world model approaches.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 37 of its 67 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

37 of 67 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026DriveVA: Video Action Models are Zero-Shot Drivers5 Apr
  2. 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
  3. 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Driving7 Jan
  4. 2025FutureX: Enhance End-to-End Autonomous Driving via Latent Chain-of-Thought World Model12 Dec
  5. 2025Latent Chain-of-Thought World Modeling for End-to-End Driving11 Dec
  6. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  7. 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
  8. 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
  9. 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generation24 Jan
  10. 2024Doe-1: Closed-Loop Autonomous Driving with Large World Model12 Dec
  11. 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
  12. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
1 more
  1. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep

Other references · 24

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  4. 2018World Modelscited by 1,444
  5. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  6. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  7. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  8. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  9. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
  10. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
  11. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
  12. 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
12 more
  1. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  2. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
  3. 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 85
  4. 2024PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Drivingcited by 84
  5. 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
  6. 2024CarLLaVA: Vision language models for camera-only closed-loop drivingcited by 57
  7. 2025DriveDPO: Policy Learning via Safety DPO For End-to-End Autonomous Drivingcited by 39
  8. 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
  9. 2025DiffAD: A Unified Diffusion Modeling Approach for Autonomous Drivingcited by 26
  10. 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Drivingcited by 26
  11. 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learningcited by 25
  12. 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failurescited by 17

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving
  2. 2026LWDrive: Layer-Wise World-Model-Guided Vision-Language Model Planning for Autonomous Driving
  3. 2026RAF-VLA: Representation Alignment with the Future for End-to-End Autonomous Driving
  4. 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving
  5. 2026Learning Vision-Language-Action World Models for Autonomous Driving
  6. 2026LMGenDrive: Bridging Multimodal Understanding and Generative World Modeling for End-to-End Driving
  7. 2026FLARE: Learning Future-Aware Latent Representations from Vision-Language Models for Autonomous Driving
  8. 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving