mlsanityData to 7 Oct 2026

Unleashing VLA Potentials in Autonomous Driving via Explicit Learning from Failures

arXiv 2603.01063 ↗First posted 1 Mar 2026cs.CVcited by 17

On the map: Vision-language-action models → VLA for autonomous driving

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models for autonomous driving often hit a performance plateau during Reinforcement Learning (RL) optimization. This stagnation arises from exploration capabilities constrained by previous Supervised Fine-Tuning (SFT), leading to persistent failures in long-tail scenarios. In these critical situations, all explored actions yield a zero-value driving score. This information-sparse reward signals a failure, yet fails to identify its root cause -- whether it is due to incorrect planning, flawed reasoning, or poor trajectory execution. To address this limitation, we propose VLA with Explicit Learning from Failures (ELF-VLA), a framework that augments RL with structured diagnostic feedback. Instead of relying on a vague scalar reward, our method produces detailed, interpretable reports that identify the specific failure mode. The VLA policy then leverages this explicit feedback to generate a Feedback-Guided Refinement. By injecting these corrected, high-reward samples back into the RL training batch, our approach provides a targeted gradient, which enables the policy to solve critical scenarios that unguided exploration cannot. Extensive experiments demonstrate that our method unlocks the latent capabilities of VLA models, achieving state-of-the-art (SOTA) performance on the public NAVSIM benchmark for overall PDMS, EPDMS score and high-level planning accuracy.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 40 of its 43 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

40 of 43 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Driving14 Oct
  2. 2025A Survey on Vision-Language-Action Models for Autonomous Driving30 Jun
  3. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning16 Jun
  4. 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Models29 May

Other references · 36

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  4. 2022Planning-oriented Autonomous Drivingcited by 1,068
  5. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  6. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
  7. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  8. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  9. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
  10. 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
  11. 2025Learning to Reason under Off-Policy Guidancecited by 266
  12. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 258
24 more
  1. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
  2. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  3. 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 190
  4. 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
  5. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  6. 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 145
  7. 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 144
  8. 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoningcited by 142
  9. 2025Pseudo-Simulation for Autonomous Drivingcited by 141
  10. 2025GoalFlow: Goal-Driven Flow Matching for Multimodal Trajectories Generation in End-to-End Autonomous Drivingcited by 117
  11. 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
  12. 2022A Survey on Safety-Critical Driving Scenario Generation -- A Methodological Perspectivecited by 100
  13. 2025Learning What Reinforcement Learning Can't: Interleaved Online Fine-Tuning for Hardest Questionscited by 95
  14. 2024OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Drivingcited by 93
  15. 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
  16. 2025Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedbackcited by 86
  17. 2024Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Modelscited by 75
  18. 2022"Curse of rarity" for autonomous vehiclescited by 62
  19. 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
  20. 2025Hydra-NeXt: Robust Closed-Loop Driving with Open-Loop Trainingcited by 39
  21. 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learningcited by 38
  22. 2025Sce2DriveX: A Generalized MLLM Framework for Scene-to-Drive Learningcited by 25
  23. 2025ReasonPlan: Unified Scene Prediction and Decision Reasoning for Closed-loop Autonomous Drivingcited by 22
  24. 2025MTRDrive: Memory-Tool Synergistic Reasoning for Robust Autonomous Driving in Corner Casescited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 17.

17 papers.

Sort:

By area:

  1. 2026UniDriveVLA: Unifying Understanding, Perception, and Action Planning for Autonomous Drivingcited by 17
  2. 2026DriveFuture: Future-Aware Latent World Models for Autonomous Drivingcited by 15
  3. 2026DVGT-2: Vision-Geometry-Action Model for Autonomous Driving at Scalecited by 12
  4. 2026EponaV2: Driving World Model with Comprehensive Future Reasoningcited by 12
  5. 2026Xiaomi OneVL: One-Step Latent Reasoning and Planning with Vision-Language Explanationcited by 9
  6. 2026Intend, Reflect, Refine: An Adaptive Multimodal Reflection Framework for Autonomous Drivingcited by 2
  7. 2026Post-Training in End-to-End Autonomous Drivingcited by 2
  8. 2026DriveReward: A Comprehensive Dataset and Generative Vision-Language Reward Model for Autonomous Drivingcited by 1
  9. 2026DriveVer: Lightweight Trajectory Evaluator as Test-Time Verifier for Autonomous Drivingcited by 1
  10. 2026FIRE-VLA: Failure-Informed Self-Evolution for Vision-Language-Action Models in Autonomous Drivingcited by 1
  11. 2026LVDrive: Latent Visual Representation Enhanced Vision-Language-Action Autonomous Driving Modelcited by 0
  12. 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulationcited by 0
5 more
  1. 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
  2. 2026Evaluation Is All You Need for Multi-Modal Autonomous Drivingcited by 0
  3. 2026CAR-VLA: Complexity-Aware and Risk-Adaptive Reasoning for Autonomous Drivingcited by 0
  4. 2026RefineDrive: Reliable Failure-Guided Learning for Vision-Language-Action Drivingcited by 0
  5. 2026BridgeGuard: Explicit Safety Drift for Diffusion-based Autonomous Drivingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025IRL-VLA: Training an Vision-Language-Action Policy via Reward World Model
  2. 2025VDRive: Leveraging Reinforced VLA and Diffusion Policy for End-to-end Autonomous Driving
  3. 2024VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Driving
  4. 2026Learning from Mistakes: Post-Training for Driving VLA with Takeover Data
  5. 2026Devil is in Narrow Policy: Unleashing Exploration in Driving VLA Models
  6. 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Driving
  7. 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
  8. 2026DriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Driving