mlsanityData to 7 Oct 2026

Less is More: Lean yet Powerful Vision-Language Model for Autonomous Driving

arXiv 2510.00060 ↗First posted 29 Sep 2025cs.CV cs.AI cs.ROcited by 0

On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection

also in 1 more
Abstract (arXiv)

In this work, we reconceptualize autonomous driving as a generalized language problem and formulate the trajectory planning task as next waypoint prediction. We introduce Max-V1, a novel framework for one-stage end-to-end autonomous driving, named in tribute to the renowned Dutch racing driver Max Verstappen. Our framework presents a single-pass generation paradigm that aligns with the inherent sequentiality of driving. This approach leverages the generative capacity of the Vision-Language Model (VLM) to enable end-to-end trajectory prediction directly from front-view camera input. The efficacy of this method is underpinned by a principled supervision strategy derived from statistical modeling. This provides a well-defined learning objective, which makes the framework highly amenable to mastering complex driving policies through imitation learning from large-scale expert demonstrations. Empirically, our method achieves state-of-the-art performance on the nuScenes dataset, delivering an overall improvement of over 30% compared to prior baselines. Furthermore, it exhibits superior generalization performance on cross-domain datasets acquired from diverse vehicles, demonstrating notable potential for cross-vehicle robustness and adaptability. With these empirical strengths, this work introduces a model that enables fundamental driving behaviors, laying the foundation for the development of more capable self-driving agents. Code will be available upon publication.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 13 of its 30 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

13 of 30 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Driving1 May
  2. 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Driving19 Dec
  3. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Driving29 Oct
  4. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Models19 Feb

Other references · 9

  1. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  2. 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 287
  3. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
  4. 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 239
  5. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  6. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
  7. 2024Navigation-Guided Sparse Scene Representation for End-to-End Autonomous Drivingcited by 46
  8. 2025VERDI: VLM-Embedded Reasoning for Autonomous Drivingcited by 15
  9. 2024doScenes: An Autonomous Driving Dataset with Natural Language Instruction for Human Interaction and Vision-Language Navigationcited by 14

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planning
  2. 2026Less Language, More Latents: Annotation-Efficient VLAs for Driving
  3. 2026Vega: Learning to Drive with Natural Language Instructions
  4. 2026Efficient and Explainable End-to-End Autonomous Driving via Masked Vision-Language-Action Diffusion
  5. 2025SOLVE: Synergy of Language-Vision and End-to-End Networks for Autonomous Driving
  6. 2025ViLaD: A Large Vision Language Diffusion Framework for End-to-End Autonomous Driving
  7. 2025Structured Labeling Enables Faster Vision-Language Models for End-to-End Autonomous Driving
  8. 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervision