Less is More: Lean yet Powerful Vision-Language Model for Autonomous Driving
On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection
also in 1 more
Abstract (arXiv)
In this work, we reconceptualize autonomous driving as a generalized language problem and formulate the trajectory planning task as next waypoint prediction. We introduce Max-V1, a novel framework for one-stage end-to-end autonomous driving, named in tribute to the renowned Dutch racing driver Max Verstappen. Our framework presents a single-pass generation paradigm that aligns with the inherent sequentiality of driving. This approach leverages the generative capacity of the Vision-Language Model (VLM) to enable end-to-end trajectory prediction directly from front-view camera input. The efficacy of this method is underpinned by a principled supervision strategy derived from statistical modeling. This provides a well-defined learning objective, which makes the framework highly amenable to mastering complex driving policies through imitation learning from large-scale expert demonstrations. Empirically, our method achieves state-of-the-art performance on the nuScenes dataset, delivering an overall improvement of over 30% compared to prior baselines. Furthermore, it exhibits superior generalization performance on cross-domain datasets acquired from diverse vehicles, demonstrating notable potential for cross-vehicle robustness and adaptability. With these empirical strengths, this work introduces a model that enables fundamental driving behaviors, laying the foundation for the development of more capable self-driving agents. Code will be available upon publication.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 30 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
13 of 30 references.
Closest ancestors · 4
Same direction, newest first
- 2025LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Driving1 May
- 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Driving19 Dec
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Driving29 Oct
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Models19 Feb
Other references · 9
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2024Navigation-Guided Sparse Scene Representation for End-to-End Autonomous Drivingcited by 46
- 2025VERDI: VLM-Embedded Reasoning for Autonomous Drivingcited by 15
- 2024doScenes: An Autonomous Driving Dataset with Natural Language Instruction for Human Interaction and Vision-Language Navigationcited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planning
- 2026Less Language, More Latents: Annotation-Efficient VLAs for Driving
- 2026Vega: Learning to Drive with Natural Language Instructions
- 2026Efficient and Explainable End-to-End Autonomous Driving via Masked Vision-Language-Action Diffusion
- 2025SOLVE: Synergy of Language-Vision and End-to-End Networks for Autonomous Driving
- 2025ViLaD: A Large Vision Language Diffusion Framework for End-to-End Autonomous Driving
- 2025Structured Labeling Enables Faster Vision-Language Models for End-to-End Autonomous Driving
- 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervision