SafeAlign-VLA: A Negative-Enhanced Safe Alignment Framework for Risk-Aware Autonomous Driving
On the map: End-to-end autonomous driving → Reinforcement learning for driving
Abstract (arXiv)
End-to-end autonomous driving systems excel in common scenarios but struggle with safety-critical long-tail cases. Vision-Language-Action (VLA) models are promising due to their strong reasoning capabilities. However, most VLA-based approaches rely on positive expert demonstrations, rarely exploiting negative samples, leading to insufficient understanding of risky behaviors and safety boundaries. To address this limitation, we propose SafeAlign-VLA, a unified negative-enhanced safe alignment framework that incorporates negative data into supervised learning and reinforcement learning. First, we develop a counterfactual safety pairing paradigm to generate structured safety labels and counterfactual positive trajectories from risky scenarios via counterfactual reasoning. Then, a two-stage training strategy is adopted: negative-enhanced supervised fine-tuning for failure feedback and trajectory correction, followed by anchor-based group relative policy optimization that uses positive and negative trajectories as contrastive anchors to steer sampling and penalize high-risk behaviors via group-relative advantages. Experiments on NAVSIM and DeepAccident validate the proposed framework. SafeAlign-VLA achieves 89.1 PDMS on the NAVSIM v1 testset, improving over the baseline without negative data by 1.3%. On DeepAccident, it reduces the collision rate to 3.36%, while achieving 84.2% language accuracy and 85.8% risk prediction accuracy. These results demonstrate the effectiveness of the proposed negative-enhanced safe alignment framework for safe and robust autonomous driving.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for driving, one of 9 directions in End-to-end autonomous driving. Builds on 50 of its 59 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
50 of 59 references.
Closest ancestors · 1
Same direction, newest first
- 2025ADReFT: Adaptive Decision Repair for Safe Autonomous Driving via Reinforcement Fine-Tuning30 Jun
Other references · 49
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 397
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
- 2022ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learningcited by 368
- 2024NAVSIM: Data-Driven Non-Reactive Autonomous Vehicle Simulation and Benchmarkingcited by 354
37 more
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 346
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 334
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
- 2024VADv2: End-to-End Vectorized Autonomous Driving via Probabilistic Planningcited by 289
- 2025AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuningcited by 260
- 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baselinecited by 248
- 2024SparseDrive: End-to-End Autonomous Driving via Sparse Scene Representationcited by 241
- 2025ReCogDrive: A Reinforced Cognitive Framework for End-to-End Autonomous Drivingcited by 198
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
- 2025ORION: A Holistic End-to-End Autonomous Driving Framework by Vision-Language Instructed Action Generationcited by 178
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 176
- 2025End-to-End Driving with Online Trajectory Evaluation via BEV World Modelcited by 151
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 150
- 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 145
- 2025OmniDrive: A Holistic Vision-Language Dataset for Autonomous Driving with Counterfactual Reasoningcited by 143
- 2022Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarioscited by 129
- 2023Reason2Drive: Towards Interpretable and Chain-based Reasoning for Autonomous Drivingcited by 123
- 2025AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoningcited by 108
- 2023Hidden Biases of End-to-End Driving Modelscited by 96
- 2024DrivingGPT: Unifying Driving World Modeling and Planning with Multi-modal Autoregressive Transformerscited by 96
- 2024PLUTO: Pushing the Limit of Imitation Learning-based Planning for Autonomous Drivingcited by 84
- 2021Explanations in Autonomous Driving: A Surveycited by 81
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 74
- 2023DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Drivingcited by 73
- 2025ARTEMIS: Autoregressive End-to-End Trajectory Planning with Mixture of Experts for Autonomous Drivingcited by 67
- 2025DriveDPO: Policy Learning via Safety DPO For End-to-End Autonomous Drivingcited by 39
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
- 2025Sce2DriveX: A Generalized MLLM Framework for Scene-to-Drive Learningcited by 25
- 2026SpanVLA: Efficient Action Bridging and Learning from Negative-Recovery Samples for Vision-Language-Action Modelcited by 17
- 2025Enhancing Autonomous Driving Safety with Collision Scenario Integrationcited by 9
- 2025CDKFormer: Contextual Deviation Knowledge-Based Transformer for Long-Tail Trajectory Predictioncited by 4
- 2025RoboTron-Sim: Improving Real-World Driving via Simulated Hard-Casecited by 4
- 2025The Case for Negative Data: From Crash Reports to Counterfactuals for Reasonable Drivingcited by 3
- 2026C-CoT: Counterfactual Chain-of-Thought with Vision-Language Models for Safe Autonomous Drivingcited by 3
- 2025LIFT: Interpretable truck driving risk prediction with literature-informed fine-tuned LLMscited by 2
- 2026BAP-SRL: Bayesian Adaptive Priority Safe Reinforcement Learning for Vehicle Motion Planning at Mixed Traffic Intersectionscited by 2
- 2025Controllable risk scenario generation from human crash data for autonomous vehicle testingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025VLM-SAFE: Vision-Language Model-Guided Safety-Aware Reinforcement Learning with World Models for Autonomous Driving
- 2026SafeDriveVLA: Navigation-Conditioned World Model Dreaming for Conflict-Aware End-to-End Autonomous Driving
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learning
- 2022SafeRL-Kit: Evaluating Efficient Reinforcement Learning Methods for Safe Autonomous Driving
- 2026ShieldVLA: Feasibility-Aware Safety Alignment for Vision-Language-Action Models
- 2026From Attacks to Curricula: Learnability-Guided Adversarial Training for Safe Autonomous Driving
- 2025Plan-R1: Safe and Feasible Trajectory Planning as Language Modeling
- 2026Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning