mlsanityData to 7 Oct 2026

Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanisms

arXiv 2604.23775 ↗First posted 26 Apr 2026cs.ROcited by 12

On the map: Vision-language-action models → Safety and adversarial attacks

Abstract (arXiv)

Vision-Language-Action (VLA) models are emerging as a unified substrate for embodied intelligence. This shift raises a new class of safety challenges, stemming from the embodied nature of VLA systems, including irreversible physical consequences, a multimodal attack surface across vision, language, and state, real-time latency constraints on defense, error propagation over long-horizon trajectories, and vulnerabilities in the data supply chain. Yet the literature remains fragmented across robotic learning, adversarial machine learning, AI alignment, and autonomous systems safety. This survey provides a unified and up-to-date overview of safety in Vision-Language-Action models. We organize the field along two parallel timing axes, attack timing (training-time vs. inference-time and defense timing (training-time vs. inference-time, linking each class of threat to the stage at which it can be mitigated. We first define the scope of VLA safety, distinguishing it from text-only LLM safety and classical robotic safety, and review the foundations of VLA models, including architectures, training paradigms, and inference mechanisms. We then examine the literature through four lenses: Attacks, Defenses, Evaluation, and Deployment. We survey training-time threats such as data poisoning and backdoors, as well as inference-time attacks including adversarial patches, cross-modal perturbations, semantic jailbreaks, and freezing attacks. We review training-time and runtime defenses, analyze existing benchmarks and metrics, and discuss safety challenges across six deployment domains. Finally, we highlight key open problems, including certified robustness for embodied trajectories, physically realizable defenses, safety-aware training, unified runtime safety architectures, and standardized evaluation.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Safety and adversarial attacks, one of 13 directions in Vision-language-action models. Builds on 83 of its 95 references that are in the map. First posted on arXiv 26 Apr 2026.

Builds on

83 of 95 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026HazardArena: Evaluating Semantic Safety in Vision-Language-Action Models14 Apr
  2. 2026Safe-Night VLA: Seeing the Unseen via Thermal-Perceptive Vision-Language-Action Models for Safety-Critical Manipulation5 Mar
  3. 2026SilentDrift: Exploiting Action Chunking for Stealthy Backdoor Attacks on Vision-Language-Action Models20 Jan
  4. 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Space7 Jan
  5. 2025VLSA: Vision-Language-Action Models with Plug-and-Play Safety Constraint Layer9 Dec
  6. 2025When Alignment Fails: Multimodal Adversarial Attacks on Vision-Language-Action Models20 Nov
  7. 2025Phantom Menace: Exploring and Enhancing the Robustness of VLA Models Against Physical Sensor Attacks13 Nov
  8. 2025DropVLA: An Action-Level Backdoor Attack on Vision-Language-Action Models13 Oct
  9. 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects10 Oct
  10. 2025FreezeVLA: Action-Freezing Attacks against Vision-Language-Action Models24 Sep
  11. 2025Adversarial Attacks on Robotic Vision Language Action Models3 Jun
  12. 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics18 Nov

Other references · 71

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2024The Llama 3 Herd of Modelscited by 14,192
  6. 2024GPT-4o System Cardcited by 4,467
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  8. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  10. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  11. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  12. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
38 more
  1. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  9. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  10. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  11. 2018On Evaluation of Embodied Navigation Agentscited by 526
  12. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  13. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
  14. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  15. 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
  16. 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
  17. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
  18. 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
  19. 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agentscited by 102
  20. 2024CoVLA: Comprehensive Vision-Language-Action Dataset for Autonomous Drivingcited by 74
  21. 2025SAFE: Multitask Failure Detection for Vision-Language-Action Modelscited by 74
  22. 2025A Survey on Vision-Language-Action Models for Autonomous Drivingcited by 72
  23. 2024VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Drivingcited by 49
  24. 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
  25. 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
  26. 2024VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulationcited by 43
  27. 2024A Survey of Constraint Formulations in Safe Reinforcement Learningcited by 42
  28. 2024Surgical-LVLM: Learning to Adapt Large Vision-Language Model for Grounded Visual Question Answering in Robotic Surgerycited by 39
  29. 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
  30. 2024Run-time Observation Interventions Make Vision-Language-Action Models More Visually Robustcited by 33
  31. 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructionscited by 33
  32. 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Modelscited by 33
  33. 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 32
  34. 2025Safety Guardrails for LLM-Enabled Robotscited by 30
  35. 2024RoboNurse-VLA: Robotic Scrub Nurse System based on Vision-Language-Action Modelcited by 28
  36. 2025Generating Robot Constitutions & Benchmarks for Semantic Safetycited by 28
  37. 2025VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Modelscited by 28
  38. 2023Safe-VLN: Collision Avoidance for Vision-and-Language Navigation of Autonomous Robots Operating in Continuous Environmentscited by 22

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Models
  2. 2026Concept-Based Dictionary Learning for Inference-Time Safety in Vision Language Action Models
  3. 2025ANNIE: Be Careful of Your Robots
  4. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
  5. 2026ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models
  6. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
  7. 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges
  8. 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts