StyleVLA: Driving Style-Aware Vision Language Action Model for Autonomous Driving
On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection
also in 2 more
Abstract (arXiv)
Vision Language Models (VLMs) bridge visual perception and linguistic reasoning. In Autonomous Driving (AD), this synergy has enabled Vision Language Action (VLA) models, which translate high-level multimodal understanding into driving behaviors, typically represented as future trajectories. However, existing VLA models mainly generate generic collision-free trajectories. Beyond collision avoidance, adapting to diverse driving styles (e.g., sporty, comfortable) is essential for personalized driving. Moreover, many methods treat trajectory generation as naive token prediction, which can produce kinematically infeasible actions. To address these limitations, we present StyleVLA, a physics-informed VLA framework for generating diverse and physically plausible driving behaviors. We introduce a hybrid loss that combines a kinematic consistency constraint with a continuous regression head to improve trajectory feasibility. To train StyleVLA, built on Qwen3-VL-4B, we construct a large-scale instruction dataset with over 1.2k scenarios, 76k Bird's Eye View (BEV) samples, and 42k First Person View (FPV) samples, with ground-truth trajectories for five driving styles and natural-language instructions. Experiments show that our 4B-parameter StyleVLA significantly outperforms proprietary models (e.g., Gemini-3-Pro) and state-of-the-art VLA models. Using a composite driving score measuring success rate, physical feasibility, and style adherence, StyleVLA achieves 0.55 on BEV and 0.51 on FPV, versus 0.32 and 0.35 for Gemini-3-Pro. These results show that a specialized, physics-informed, lightweight model can surpass closed-source models on domain-specific tasks.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 30 of its 33 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
30 of 33 references.
Closest ancestors · 3
Same direction, newest first
- 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervision19 Dec
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Models19 Feb
- 2023DriveLM: Driving with Graph Visual Question Answering21 Dec
Other references · 27
- 2023Visual Instruction Tuningcited by 7,792
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
- 2023GPT-Driver: Learning to Drive with GPTcited by 344
- 2018The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systemscited by 276
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
15 more
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2022DRAMA: Joint Risk Localization and Captioning in Drivingcited by 125
- 2024VLP: Vision Language Planning for Autonomous Drivingcited by 125
- 2024A Survey for Foundation Models in Autonomous Drivingcited by 51
- 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 37
- 2024DriveGPT: Scaling Autoregressive Behavior Models for Drivingcited by 29
- 2023MAVERIC: A Data-Driven Approach to Personalized Autonomous Drivingcited by 22
- 2025StyleDrive: Towards Driving-Style Aware Benchmarking of End-To-End Autonomous Drivingcited by 20
- 2017Minimum Covariance Determinant and Extensionscited by 18
- 2020The NVIDIA PilotNet Experimentscited by 15
- 2024FRENETIX: A High-Performance and Modular Motion Planning Framework for Autonomous Drivingcited by 14
- 2025Foundation Models for Trajectory Planning in Autonomous Driving: A Review of Progress and Open Challengescited by 3
- 2025From Shadows to Safety: Occlusion Tracking and Risk Mitigation for Urban Autonomous Drivingcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026EgoDyn-Bench: Evaluating Ego-Motion Understanding in Vision-Centric Foundation Models for Autonomous Drivingcited by 2
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learningcited by 1
- 2026Imagined Rollouts are Kinematic, Not Dynamic: A Diagnosis of Long-Horizon World-Model Failurecited by 1
- 2026Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systemscited by 0
- 2026A Large-Language-Model Supported Personalized Driving Framework for Lane Change in Highway Scenarioscited by 0
- 2026Imagined Rollouts are Kinematic, Not Dynamic: A Diagnosis of Long-Horizon World-Model Failure7 Jul 2026
- 2026A Large-Language-Model Supported Personalized Driving Framework for Lane Change in Highway Scenarios30 Jun 2026
- 2026Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systems23 May 2026
- 2026Driving Intents Amplify Planning-Oriented Reinforcement Learning12 May 2026
- 2026EgoDyn-Bench: Evaluating Ego-Motion Understanding in Vision-Centric Foundation Models for Autonomous Driving22 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future
- 2026Judge, Then Drive: A Critic-Centric Vision Language Action Framework for Autonomous Driving
- 2025A Survey on Vision-Language-Action Models for Autonomous Driving
- 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Models
- 2026Unifying Language-Action Understanding and Generation for Autonomous Driving
- 2026Teaching Vision-Language-Action Models What to See and Where to Look
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
- 2025DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Models