mlsanityData to 7 Oct 2026

Does Visual Information Play a Decisive Role in Vision-Language-Action Model Driving Behavior?

arXiv 2605.31041 ↗First posted 29 May 2026cs.CV cs.AIcited by 0

On the map: Vision-language-action models → VLA for autonomous driving

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models have demonstrated promising capability in autonomous driving, highlighting the potential of unified multimodal architectures for jointly modeling perception and planning. However, how current VLA-based driving behavior is grounded in visual information remains poorly understood. Existing evaluation protocols mainly focus on aggregate performance metrics, lacking structured and practical diagnostics to quantify visual-behavior dependency. In this work, we introduce a structured multi-level visual perturbation framework to analyze visual-behavior dependency in VLA-based driving models systematically. The framework organizes controlled visual perturbations along three complementary dimensions: channellevel degradation, information-level disruption, and structurelevel modification. We apply it to VLA-based driving systems and evaluate behavioral responses under both open-loop trajectory prediction and interactive closed-loop safety evaluation. Experimental results reveal evaluation-dependent dependency patterns and uneven visual grounding across abstraction levels. These findings call for more structured analyses and principled design of VLA driving models to better understand how visual information shapes behavior and develop safer, more robust systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 23 of its 27 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

23 of 27 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026SteerVLA: Steering Vision-Language-Action Models in Long-Tail Driving Scenarios9 Feb
  2. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail30 Oct
  3. 2025A Survey on Vision-Language-Action Models for Autonomous Driving30 Jun
  4. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
  5. 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Models29 May
  6. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Model30 Mar

Other references · 17

  1. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  2. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  3. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
  4. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  5. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
  6. 2017Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answeringcited by 337
  7. 2020Counterfactual VQA: A Cause-Effect Look at Language Biascited by 266
  8. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 259
  9. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
  10. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
  11. 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
  12. 2019Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Groundedcited by 127
5 more
  1. 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 112
  2. 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 72
  3. 2024NeuroNCAP: Photorealistic Closed-loop Safety Testing for Autonomous Drivingcited by 61
  4. 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learningcited by 38
  5. 2025Decoupling Scene Perception and Ego Status: A Multi-Context Fusion Approach for Enhanced Generalization in End-to-End Autonomous Drivingcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future
  2. 2026Judge, Then Drive: A Critic-Centric Vision Language Action Framework for Autonomous Driving
  3. 2025DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Models
  4. 2026StyleVLA: Driving Style-Aware Vision Language Action Model for Autonomous Driving
  5. 2025Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Driving
  6. 2026Learning Vision-Language-Action World Models for Autonomous Driving
  7. 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Driving
  8. 2025LightEMMA: A Longitudinal Evaluation of Vision-Language Models for Autonomous Driving