Judge, Then Drive: A Critic-Centric Vision Language Action Framework for Autonomous Driving
On the map: Vision-language-action models → VLA for autonomous driving
also in 1 more
Abstract (arXiv)
Recent advances in vision language action (VLA) models have shown remarkable potential for autonomous driving by directly mapping multimodal inputs to control signals. However, previous VLA-based methods have not explicitly exploited the critic capability of VLAs to refine driving decisions, even though such capability has been well demonstrated in other LLM-based domains, thereby limiting their performance in complex closed-loop scenarios. In this work, we present a theoretically inspired two-stage framework, CriticVLA, which extends the role of VLAs from acting to judging. CriticVLA first generates a rough trajectory and then refines it through multimodal evaluation and single-step optimization guided by a VLA-based critic, yielding higher-quality driving behaviors. To support this process, we construct a large-scale synthetic dataset of 12.9 million annotated trajectories covering diverse driving scenarios, which enhances the critic's reasoning and refinement abilities. Extensive closed-loop experiments on the Bench2Drive benchmark show that CriticVLA significantly surpasses state-of-the-art baselines, achieving a 73.33% total success rate and delivering about 30% improvement in challenging scenarios.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 30 of its 69 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
30 of 69 references.
Closest ancestors · 1
Same direction, newest first
Other references · 29
- 2023GPT-4 Technical Reportcited by 18,132
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024Qwen2 Technical Reportcited by 2,076
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2024OpenAI o1 System Cardcited by 1,220
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
- 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 250
17 more
- 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 177
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Drivingcited by 125
- 2023PRD: Peer Rank and Discussion Improve Large Language Model based Evaluationscited by 114
- 2024RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Modelcited by 91
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 72
- 2024DriveCoT: Integrating Chain-of-Thought Reasoning with End-to-End Drivingcited by 67
- 2025DiffVLA: Vision-Language Guided Diffusion Planning for Autonomous Drivingcited by 64
- 2025RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMscited by 58
- 2024Human-Centered Design Recommendations for LLM-as-a-Judgecited by 35
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 34
- 2024Hidden Biases of End-to-End Driving Datasetscited by 30
- 2025SafeAuto: Knowledge-Enhanced Safe Autonomous Driving with Multimodal Foundation Modelscited by 22
- 2023A Closer Look into Automatic Evaluation Using Large Language Modelscited by 17
- 2025BridgeDrive: Diffusion Bridge Policy for Closed-Loop Trajectory Planning in Autonomous Drivingcited by 17
- 2025Chain-of-Thought for Autonomous Driving: A Comprehensive Survey and Future Prospectscited by 12
- 2025MiniLongBench: The Low-cost Long Context Understanding Benchmark for Large Language Modelscited by 7
- 2023HeadCraft: Modeling High-Detail Shape Variations for Animated 3DMMscited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Drivingcited by 1
- 2026Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systemscited by 0
- 2026Drive by Hindsight and Foresight: Tool-Grounded Synergistic Reasoning over Hierarchical Memory for Autonomous Drivingcited by 0
- 2026Drive by Hindsight and Foresight: Tool-Grounded Synergistic Reasoning over Hierarchical Memory for Autonomous Driving8 Sep 2026
- 2026BLUE: Toward Better Language Use in Efficient Vision-Language-Action Models for Autonomous Driving7 Jun 2026
- 2026Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systems23 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future
- 2025DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Models
- 2025VDRive: Leveraging Reinforced VLA and Diffusion Policy for End-to-end Autonomous Driving
- 2025Reasoning-VLA: A Fast and General Vision-Language-Action Reasoning Model for Autonomous Driving
- 2025Impromptu VLA: Open Weights and Open Data for Driving Vision-Language-Action Models
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
- 2026Learning Vision-Language-Action World Models for Autonomous Driving
- 2026Teaching Vision-Language-Action Models What to See and Where to Look