LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Model
On the map: World models → World models for autonomous driving
also in 2 more
Abstract (arXiv)
Vision-Language-Action (VLA) models have emerged as a promising framework for end-to-end autonomous driving. However, existing VLAs typically rely on sparse action supervision, which underutilizes their powerful scene understanding and reasoning capabilities. Recent attempts to incorporate dense visual supervision via world modeling often overemphasize pixel-level image reconstruction, neglecting semantically meaningful scene representation learning. In this work, we propose LVDrive, a Latent Visual representation enhanced VLA framework for autonomous driving. LVDrive introduces a future scene prediction task into the VLA paradigm, where future representations are learned entirely in a high-level latent space under auxiliary supervision from a pretrained vision backbone. Departing from inefficient autoregressive generation, we jointly model future scene and motion prediction within a unified embedding space, processed in a single forward pass to conduct the future-aware reasoning. We further design a two-stage trajectory decoding strategy that explicitly leverages the learned latent future representations to refine trajectory generation. Extensive experiments on the challenging Bench2Drive benchmark demonstrate that LVDrive achieves significant improvements in closed-loop driving performance, outperforming both action supervised methods and image-reconstruction-based world model approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 37 of its 67 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
37 of 67 references.
Closest ancestors · 13
Same direction, newest first
- 2026DriveVA: Video Action Models are Zero-Shot Drivers5 Apr
- 2026DriveWorld-VLA: Unified Latent-Space World Modeling with Vision-Language-Action for Autonomous Driving6 Feb
- 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Driving7 Jan
- 2025FutureX: Enhance End-to-End Autonomous Driving via Latent Chain-of-Thought World Model12 Dec
- 2025Latent Chain-of-Thought World Modeling for End-to-End Driving11 Dec
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
- 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Model1 Jul
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
- 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generation24 Jan
- 2024Doe-1: Closed-Loop Autonomous Driving with Large World Model12 Dec
- 2024Enhancing End-to-End Autonomous Driving with Latent World Model12 Jun
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
1 more
Other references · 24
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2018World Modelscited by 1,444
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2025FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Drivingcited by 165
12 more
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2025DriveMoE: Mixture-of-Experts for Vision-Language-Action Model in End-to-End Autonomous Drivingcited by 85
- 2024PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Drivingcited by 84
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2024CarLLaVA: Vision language models for camera-only closed-loop drivingcited by 57
- 2025DriveDPO: Policy Learning via Safety DPO For End-to-End Autonomous Drivingcited by 39
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
- 2025DiffAD: A Unified Diffusion Modeling Approach for Autonomous Drivingcited by 26
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Drivingcited by 26
- 2025MindDrive: A Vision-Language-Action Model for Autonomous Driving via Online Reinforcement Learningcited by 25
- 2026Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failurescited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving
- 2026LWDrive: Layer-Wise World-Model-Guided Vision-Language Model Planning for Autonomous Driving
- 2026RAF-VLA: Representation Alignment with the Future for End-to-End Autonomous Driving
- 2026WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving
- 2026Learning Vision-Language-Action World Models for Autonomous Driving
- 2026LMGenDrive: Bridging Multimodal Understanding and Generative World Modeling for End-to-End Driving
- 2026FLARE: Learning Future-Aware Latent Representations from Vision-Language Models for Autonomous Driving
- 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving