BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimization
On the map: Vision-language-action models → Safety and adversarial attacks
also in 1 more
Abstract (arXiv)
Vision-Language-Action (VLA) models have advanced robotic control by enabling end-to-end decision-making directly from multimodal inputs. However, their tightly coupled architectures expose novel security vulnerabilities. Unlike traditional adversarial perturbations, backdoor attacks represent a stealthier, persistent, and practically significant threat-particularly under the emerging Training-as-a-Service paradigm-but remain largely unexplored in the context of VLA models. To address this gap, we propose BadVLA, a backdoor attack method based on Objective-Decoupled Optimization, which for the first time exposes the backdoor vulnerabilities of VLA models. Specifically, it consists of a two-stage process: (1) explicit feature-space separation to isolate trigger representations from benign inputs, and (2) conditional control deviations that activate only in the presence of the trigger, while preserving clean-task performance. Empirical results on multiple VLA benchmarks demonstrate that BadVLA consistently achieves near-100% attack success rates with minimal impact on clean task accuracy. Further analyses confirm its robustness against common input perturbations, task transfers, and model fine-tuning, underscoring critical security vulnerabilities in current VLA deployments. Our work offers the first systematic investigation of backdoor vulnerabilities in VLA models, highlighting an urgent need for secure and trustworthy embodied model design practices. We have released the project page at https://badvla-project.github.io/.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Placed in Safety and adversarial attacks, one of 13 directions in Vision-language-action models. Builds on 41 of its 51 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
41 of 51 references.
Closest ancestors · 2
Same direction, newest first
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics18 Nov
- 2024Manipulation Facing Threats: Evaluating Physical Vulnerabilities in End-to-End Vision Language Action Models20 Sep
Other references · 39
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2020Backdoor Learning: A Surveycited by 412
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
27 more
- 2017Certified Defenses for Data Poisoning Attackscited by 288
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2023PaLI-X: On Scaling up a Multilingual Vision and Language Modelcited by 254
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 212
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
- 2024Prompt Infection: LLM-to-LLM Prompt Injection within Multi-Agent Systemscited by 126
- 2024Dissecting Adversarial Robustness of Multimodal LM Agentscited by 118
- 2021Towards artificial general intelligence via a multimodal foundation modelcited by 112
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 83
- 2024A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trendscited by 82
- 2023Black-box Backdoor Defense via Zero-shot Image Purificationcited by 44
- 2024TrojVLM: Backdoor Attack Against Vision Language Modelscited by 35
- 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Drivingcited by 35
- 2022Robustness of Learning from Task Instructionscited by 34
- 2024Revisiting the Adversarial Robustness of Vision Language Models: a Multimodal Perspectivecited by 28
- 2024Safety Alignment for Vision Language Modelscited by 27
- 2024Unraveling and Mitigating Safety Alignment Degradation of Vision-Language Modelscited by 23
- 2024Benchmarking Vision, Language, & Action Models on Robotic Learning Taskscited by 23
- 2023InstructTA: Instruction-Tuned Targeted Attack for Large Vision-Language Modelscited by 21
- 2022Friendly Noise against Adversarial Noise: A Powerful Defense against Data Poisoning Attackscited by 20
- 2022Compression-Resistant Backdoor Attack against Deep Neural Networkscited by 14
- 2024BadCM: Invisible Backdoor Attack Against Cross-Modal Learningcited by 9
- 2024Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Realitycited by 8
- 2024Task-oriented Robotic Manipulation with Vision Language Modelscited by 3
- 2016GaDei: On Scale-up Training As A Service For Deep Learningcited by 1
Built on by
Citing papers per year: 2025: 7; 2026: 30.
37 papers.
Sort:
By area:
- 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objectscited by 16
- 2025IAG: Input-aware Backdoor Attack on VLM-based Visual Groundingcited by 11
- 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Modelscited by 10
- 2025When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Modelscited by 9
- 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Spacecited by 9
- 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuningcited by 7
- 2025DropVLA: An Action-Level Backdoor Attack on Vision-Language-Action Modelscited by 5
- 2026TRAP: Hijacking VLA CoT-Reasoning via Adversarial Patchescited by 5
- 2026SilentDrift: Exploiting Action Chunking for Stealthy Backdoor Attacks on Vision-Language-Action Modelscited by 4
- 2026TRAP: Tail-aware Ranking Attack for World-Model Planningcited by 4
- 2026SlowBA: An efficiency backdoor attack towards VLM-based GUI agentscited by 3
- 2026Making MLLMs Blind: Adversarial Smuggling Attacks in MLLM Content Moderationcited by 3
25 more
- 2026VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijackingcited by 3
- 2025ANNIE: Be Careful of Your Robotscited by 2
- 2026SABER: A Stealthy Agentic Black-Box Attack Framework for Vision-Language-Action Modelscited by 2
- 2026Towards Backdoor-Based Ownership Verification for Vision-Language-Action Modelscited by 2
- 2026Partially Observable Adversarial Patch Attacks on Vision-Language-Action Models in Roboticscited by 2
- 2026Uncovering Vulnerability of Vision-Language-Action Models under Joint-Level Physical Faultscited by 2
- 2026VLALeaks: Membership Inference Attacks against Vision-Language-Action Modelscited by 2
- 2026ActFovea: Runtime Safeguarding for VLA Policies via Spatiotemporal Visual-Action Consistencycited by 2
- 2026FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Modelscited by 1
- 2026Lights, Camera, Malfunction: When Illumination Robustness Leaves VLA Models Blind to Colorcited by 1
- 2026DRIFT: Derailing Denoising Trajectories of Flow-Matching VLAs with Adversarial Patch Attackcited by 1
- 2025Backdoor Attacks on Prompt-Driven Video Segmentation Foundation Modelscited by 0
- 2026Altered Thoughts, Altered Actions: Probing Chain-of-Thought Vulnerabilities in VLA Robotic Manipulationcited by 0
- 2026RedVLA: Physical Red Teaming for Vision-Language-Action Modelscited by 0
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliabilitycited by 0
- 2026ReasonBreak: Probing Vulnerabilities in Reasoning-Enabled Vision-Language-Action Models for Autonomous Drivingcited by 0
- 2026Targeting World Models to Compromise Robot Learning Pipelinescited by 0
- 2026!Imperio, smolVLA: The Implications of Data Poisoning on Open Source Roboticscited by 0
- 2026VLAGuard: A Framework for Evaluating and Mitigating Physical Attention Hijacking in Vision-Language-Action Robots within Wireless Sensor Networkscited by 0
- 2026UniTexture: Cross-Task Universal Adversarial Textures for Vision-Language-Action Modelscited by 0
- 2026Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerabilitycited by 0
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluationcited by 0
- 2026TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modescited by 0
- 2026Validating, Not Sampling: Region-Level Robustness of Vision-Language and Vision-Language-Action Modelscited by 0
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directionscited by 0
- 2026Validating, Not Sampling: Region-Level Robustness of Vision-Language and Vision-Language-Action Models14 Sep 2026
- 2026TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modes27 Aug 2026
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directions19 Aug 2026
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation17 Aug 2026
- 2026Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability16 Aug 2026
- 2026UniTexture: Cross-Task Universal Adversarial Textures for Vision-Language-Action Models13 Aug 2026
- 2026DRIFT: Derailing Denoising Trajectories of Flow-Matching VLAs with Adversarial Patch Attack4 Aug 2026
- 2026VLAGuard: A Framework for Evaluating and Mitigating Physical Attention Hijacking in Vision-Language-Action Robots within Wireless Sensor Networks2 Aug 2026
- 2026ActFovea: Runtime Safeguarding for VLA Policies via Spatiotemporal Visual-Action Consistency31 Jul 2026
- 2026Lights, Camera, Malfunction: When Illumination Robustness Leaves VLA Models Blind to Color16 Jul 2026
- 2026!Imperio, smolVLA: The Implications of Data Poisoning on Open Source Robotics5 Jul 2026
- 2026VLALeaks: Membership Inference Attacks against Vision-Language-Action Models13 Jun 2026
25 more
- 2026Uncovering Vulnerability of Vision-Language-Action Models under Joint-Level Physical Faults9 Jun 2026
- 2026Targeting World Models to Compromise Robot Learning Pipelines8 Jun 2026
- 2026Partially Observable Adversarial Patch Attacks on Vision-Language-Action Models in Robotics2 Jun 2026
- 2026ReasonBreak: Probing Vulnerabilities in Reasoning-Enabled Vision-Language-Action Models for Autonomous Driving27 May 2026
- 2026VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijacking27 May 2026
- 2026Towards Backdoor-Based Ownership Verification for Vision-Language-Action Models9 May 2026
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliability8 May 2026
- 2026TRAP: Tail-aware Ranking Attack for World-Model Planning3 May 2026
- 2026RedVLA: Physical Red Teaming for Vision-Language-Action Models24 Apr 2026
- 2026Making MLLMs Blind: Adversarial Smuggling Attacks in MLLM Content Moderation8 Apr 2026
- 2026FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Models30 Mar 2026
- 2026SABER: A Stealthy Agentic Black-Box Attack Framework for Vision-Language-Action Models26 Mar 2026
- 2026TRAP: Hijacking VLA CoT-Reasoning via Adversarial Patches24 Mar 2026
- 2026Altered Thoughts, Altered Actions: Probing Chain-of-Thought Vulnerabilities in VLA Robotic Manipulation13 Mar 2026
- 2026SlowBA: An efficiency backdoor attack towards VLM-based GUI agents9 Mar 2026
- 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuning31 Jan 2026
- 2026SilentDrift: Exploiting Action Chunking for Stealthy Backdoor Attacks on Vision-Language-Action Models20 Jan 2026
- 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Space7 Jan 2026
- 2025Backdoor Attacks on Prompt-Driven Video Segmentation Foundation Models26 Dec 2025
- 2025When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Models26 Nov 2025
- 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Models15 Nov 2025
- 2025DropVLA: An Action-Level Backdoor Attack on Vision-Language-Action Models13 Oct 2025
- 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects10 Oct 2025
- 2025ANNIE: Be Careful of Your Robots3 Sep 2025
- 2025IAG: Input-aware Backdoor Attack on VLM-based Visual Grounding13 Aug 2025
- 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objectscited by 16
- 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Modelscited by 10
- 2025When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Modelscited by 9
- 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Spacecited by 9
- 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuningcited by 7
- 2025DropVLA: An Action-Level Backdoor Attack on Vision-Language-Action Modelscited by 5
- 2026SilentDrift: Exploiting Action Chunking for Stealthy Backdoor Attacks on Vision-Language-Action Modelscited by 4
- 2026VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijackingcited by 3
- 2025ANNIE: Be Careful of Your Robotscited by 2
- 2026SABER: A Stealthy Agentic Black-Box Attack Framework for Vision-Language-Action Modelscited by 2
- 2026Towards Backdoor-Based Ownership Verification for Vision-Language-Action Modelscited by 2
- 2026Partially Observable Adversarial Patch Attacks on Vision-Language-Action Models in Roboticscited by 2
12 most cited of 22 All 22 (JSON)
- 2026TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modes27 Aug 2026
- 2026UniTexture: Cross-Task Universal Adversarial Textures for Vision-Language-Action Models13 Aug 2026
- 2026DRIFT: Derailing Denoising Trajectories of Flow-Matching VLAs with Adversarial Patch Attack4 Aug 2026
- 2026ActFovea: Runtime Safeguarding for VLA Policies via Spatiotemporal Visual-Action Consistency31 Jul 2026
- 2026Lights, Camera, Malfunction: When Illumination Robustness Leaves VLA Models Blind to Color16 Jul 2026
- 2026VLALeaks: Membership Inference Attacks against Vision-Language-Action Models13 Jun 2026
- 2026Uncovering Vulnerability of Vision-Language-Action Models under Joint-Level Physical Faults9 Jun 2026
- 2026Partially Observable Adversarial Patch Attacks on Vision-Language-Action Models in Robotics2 Jun 2026
- 2026ReasonBreak: Probing Vulnerabilities in Reasoning-Enabled Vision-Language-Action Models for Autonomous Driving27 May 2026
- 2026VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijacking27 May 2026
- 2026Towards Backdoor-Based Ownership Verification for Vision-Language-Action Models9 May 2026
- 2026RedVLA: Physical Red Teaming for Vision-Language-Action Models24 Apr 2026
12 newest of 22 All 22 (JSON)
- 2026SlowBA: An efficiency backdoor attack towards VLM-based GUI agentscited by 3
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliabilitycited by 0
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluationcited by 0
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directionscited by 0
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directions19 Aug 2026
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation17 Aug 2026
- 2026Securing Computer-Use Agents: A Unified Architecture-Lifecycle Framework for Deployment-Grounded Reliability8 May 2026
- 2026SlowBA: An efficiency backdoor attack towards VLM-based GUI agents9 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Adversarial Attacks on Robotic Vision Language Action Models
- 2026Hidden in Plain Sight: Diffusion-Based Unrestricted Robotic Attacks on Vision-Language-Action Models
- 2025FreezeVLA: Action-Freezing Attacks against Vision-Language-Action Models
- 2025BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models
- 2025Model-agnostic Adversarial Attack and Defense for Vision-Language-Action Models
- 2025Phantom Menace: Exploring and Enhancing the Robustness of VLA Models Against Physical Sensor Attacks
- 2026Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanisms
- 2026TMT: Runtime Backdoor Detection for Vision-Language-Action Policies on Unseen Tasks