mlsanityData to 7 Oct 2026

VeriDrive: Verifiable Counterfactual Supervision for Cost-Efficient Vision-Language Planning

arXiv 2606.07338 ↗First posted 5 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-language driving models increasingly use reasoning supervision to bridge perception, prediction, and planning, but existing driving rationales are often free-form and expensive to generate with frontier models. We present VeriDrive, a framework for constructing planning-oriented, verifiable counterfactual supervision. VeriDrive converts driving reasoning into a structured Perception-Evaluation-Revision chain that grounds key objects in future motion, evaluates alternative ego trajectories with rule-checkable evidence, revises risky intent toward expert behavior, and produces final planning targets. To scale data construction, VeriDrive combines local generation with validator-guided selective correction, escalating only invalid or difficult samples. We build the VeriDrive dataset on nuScenes and train under the Omni-Q protocol. Controlled open-loop experiments show that VeriDrive improves L2, Collision, and Intersection over OmniDrive while reducing logged token usage, generation time, and actual paid LLM/VLM cost. These results show that auditable intermediate fields and structured revision targets can improve vision-language planning supervision under realistic annotation budgets. Code, prompts, and validator scripts are coming soon and will be released after the review process.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 48 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

43 of 48 references.

References · 43

  1. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  4. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
  5. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  6. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  7. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  8. 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 471
  9. 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 365
  10. 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 343
  11. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 309
  12. 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 258
31 more
  1. 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 252
  2. 2024Hydra-MDP: End-to-end Multimodal Planning with Multi-target Hydra-Distillationcited by 244
  3. 2023Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving?cited by 242
  4. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  5. 2023Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenescited by 191
  6. 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
  7. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
  8. 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 161
  9. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  10. 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoningcited by 142
  11. 2024VLP: Vision Language Planning for Autonomous Drivingcited by 125
  12. 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Drivingcited by 122
  13. 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 109
  14. 2023Understanding Oversquashing in GNNs through the Lens of Effective Resistancecited by 94
  15. 2025World4Drive: End-to-End Autonomous Driving via Intention-aware Physical Latent World Modelcited by 91
  16. 2024DRAMA: An Efficient End-to-end Motion Planner for Autonomous Driving with Mambacited by 87
  17. 2023OpenLane-V2: A Topology Reasoning Benchmark for Unified 3D HD Mappingcited by 83
  18. 2025AdaThinkDrive: Adaptive Thinking via Reinforcement Learning for Autonomous Drivingcited by 57
  19. 2024Making Large Language Models Better Planners with Reasoning-Decision Alignmentcited by 51
  20. 2025Centaur: Robust End-to-End Autonomous Driving with Test-Time Trainingcited by 41
  21. 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Drivingcited by 28
  22. 2024End-to-End Autonomous Driving without Costly Modularization and 3D Manual Annotationcited by 27
  23. 2025ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Drivingcited by 24
  24. 2025SOLVE: Synergy of Language-Vision and End-to-End Networks for Autonomous Drivingcited by 21
  25. 2025Counterfactual VLA: Self-Reflective Vision-Language-Action Model with Adaptive Reasoningcited by 21
  26. 2024ActiveAD: Planning-Oriented Active Learning for End-to-End Autonomous Drivingcited by 16
  27. 2025ReAL-AD: Towards Human-Like Reasoning in End-to-End Autonomous Drivingcited by 15
  28. 2023Effective Structural Encodings via Local Curvature Profilescited by 13
  29. 2025V2V-GoT: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Models and Graph-of-Thoughtscited by 7
  30. 2025Logic-RAG: Augmenting Large Multimodal Models with Visual-Spatial Knowledge for Road Scene Understandingcited by 6
  31. 2025Unlock the Power of Unlabeled Data in Language Driving Modelcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025LaViPlan : Language-Guided Visual Path Planning with RLVR
  2. 2026Nipping the Drift in the Bud: Retrospective Rectification for Robust Vision-Language Navigation
  3. 2025More Than Meets the Eye? Uncovering the Reasoning-Planning Disconnect in Training Vision-Language Driving Models
  4. 2025Drive-R1: Bridging Reasoning and Planning in VLMs for Autonomous Driving with Reinforcement Learning
  5. 2026Cognitive Dual-Process Planning for Autonomous Driving with Structured Scene Knowledge and Verifiable Reasoning-Action Consistency
  6. 2026DriveMA: Driving Vision-Language-Action Models with verifiable Meta-Actions
  7. 2025LLaViDA: A Large Language Vision Driving Assistant for Explicit Reasoning and Enhanced Trajectory Planning
  8. 2026MIRL: Mutual Information-Guided Reinforcement Learning for Vision-Language Models