Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanisms
On the map: Vision-language-action models → Safety and adversarial attacks
Abstract (arXiv)
Vision-Language-Action (VLA) models are emerging as a unified substrate for embodied intelligence. This shift raises a new class of safety challenges, stemming from the embodied nature of VLA systems, including irreversible physical consequences, a multimodal attack surface across vision, language, and state, real-time latency constraints on defense, error propagation over long-horizon trajectories, and vulnerabilities in the data supply chain. Yet the literature remains fragmented across robotic learning, adversarial machine learning, AI alignment, and autonomous systems safety. This survey provides a unified and up-to-date overview of safety in Vision-Language-Action models. We organize the field along two parallel timing axes, attack timing (training-time vs. inference-time and defense timing (training-time vs. inference-time, linking each class of threat to the stage at which it can be mitigated. We first define the scope of VLA safety, distinguishing it from text-only LLM safety and classical robotic safety, and review the foundations of VLA models, including architectures, training paradigms, and inference mechanisms. We then examine the literature through four lenses: Attacks, Defenses, Evaluation, and Deployment. We survey training-time threats such as data poisoning and backdoors, as well as inference-time attacks including adversarial patches, cross-modal perturbations, semantic jailbreaks, and freezing attacks. We review training-time and runtime defenses, analyze existing benchmarks and metrics, and discuss safety challenges across six deployment domains. Finally, we highlight key open problems, including certified robustness for embodied trajectories, physically realizable defenses, safety-aware training, unified runtime safety architectures, and standardized evaluation.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Safety and adversarial attacks, one of 13 directions in Vision-language-action models. Builds on 83 of its 95 references that are in the map. First posted on arXiv 26 Apr 2026.
Builds on
83 of 95 references.
Closest ancestors · 12
Same direction, newest first
- 2026HazardArena: Evaluating Semantic Safety in Vision-Language-Action Models14 Apr
- 2026Safe-Night VLA: Seeing the Unseen via Thermal-Perceptive Vision-Language-Action Models for Safety-Critical Manipulation5 Mar
- 2026SilentDrift: Exploiting Action Chunking for Stealthy Backdoor Attacks on Vision-Language-Action Models20 Jan
- 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Space7 Jan
- 2025VLSA: Vision-Language-Action Models with Plug-and-Play Safety Constraint Layer9 Dec
- 2025When Alignment Fails: Multimodal Adversarial Attacks on Vision-Language-Action Models20 Nov
- 2025Phantom Menace: Exploring and Enhancing the Robustness of VLA Models Against Physical Sensor Attacks13 Nov
- 2025DropVLA: An Action-Level Backdoor Attack on Vision-Language-Action Models13 Oct
- 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects10 Oct
- 2025FreezeVLA: Action-Freezing Attacks against Vision-Language-Action Models24 Sep
- 2025Adversarial Attacks on Robotic Vision Language Action Models3 Jun
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics18 Nov
Other references · 71
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024GPT-4o System Cardcited by 4,467
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
38 more
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2018On Evaluation of Embodied Navigation Agentscited by 526
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agentscited by 102
- 2024CoVLA: Comprehensive Vision-Language-Action Dataset for Autonomous Drivingcited by 74
- 2025SAFE: Multitask Failure Detection for Vision-Language-Action Modelscited by 74
- 2025A Survey on Vision-Language-Action Models for Autonomous Drivingcited by 72
- 2024VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Drivingcited by 49
- 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
- 2024VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulationcited by 43
- 2024A Survey of Constraint Formulations in Safe Reinforcement Learningcited by 42
- 2024Surgical-LVLM: Learning to Adapt Large Vision-Language Model for Grounded Visual Question Answering in Robotic Surgerycited by 39
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2024Run-time Observation Interventions Make Vision-Language-Action Models More Visually Robustcited by 33
- 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructionscited by 33
- 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Modelscited by 33
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
- 2025Safety Guardrails for LLM-Enabled Robotscited by 30
- 2024RoboNurse-VLA: Robotic Scrub Nurse System based on Vision-Language-Action Modelcited by 28
- 2025Generating Robot Constitutions & Benchmarks for Semantic Safetycited by 28
- 2025VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Modelscited by 28
- 2023Safe-VLN: Collision Avoidance for Vision-and-Language Navigation of Autonomous Robots Operating in Continuous Environmentscited by 22
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Modelscited by 8
- 2026Uncertainty Quantification for Flow-Based Vision-Language-Action Modelscited by 4
- 2026Hallucination as Exploit: Evidence-Carrying Multimodal Agentscited by 2
- 2026BadWAM: When World-Action Models Dream Right but Act Wrongcited by 2
- 2026SPOT-E: Test-Time Entropy Shaping with Visual Spotlights for Frozen VLMscited by 1
- 2026Embodied Operators and Benchmarking: Toward Reusable and Deployable Embodied Intelligence Systemscited by 0
- 2026UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Modelscited by 0
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluationcited by 0
- 2026Logic-VLA: A Temporal Logic Conditioned Vision-Language-Action Modelcited by 0
- 2026Rethinking Language's Role in Efficient VLA for Autonomous Vehicles: Toward Smarter, Trustworthy Drivingcited by 0
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directionscited by 0
- 2026Are Vision-Language-Action Models Robust to One-Step Observation Perturbations?cited by 0
- 2026Are Vision-Language-Action Models Robust to One-Step Observation Perturbations?26 Sep 2026
- 2026Rethinking Language's Role in Efficient VLA for Autonomous Vehicles: Toward Smarter, Trustworthy Driving31 Aug 2026
- 2026Logic-VLA: A Temporal Logic Conditioned Vision-Language-Action Model20 Aug 2026
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directions19 Aug 2026
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation17 Aug 2026
- 2026UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models15 Aug 2026
- 2026BadWAM: When World-Action Models Dream Right but Act Wrong16 Jul 2026
- 2026Embodied Operators and Benchmarking: Toward Reusable and Deployable Embodied Intelligence Systems3 Jul 2026
- 2026SPOT-E: Test-Time Entropy Shaping with Visual Spotlights for Frozen VLMs18 Jun 2026
- 2026Uncertainty Quantification for Flow-Based Vision-Language-Action Models16 Jun 2026
- 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Models30 May 2026
- 2026Hallucination as Exploit: Evidence-Carrying Multimodal Agents18 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Models
- 2026Concept-Based Dictionary Learning for Inference-Time Safety in Vision Language Action Models
- 2025ANNIE: Be Careful of Your Robots
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
- 2026ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges
- 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts