Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuning
On the map: Vision-language-action models → Safety and adversarial attacks
Abstract (arXiv)
Vision-Language-Action (VLA) models have become foundational to modern embodied AI systems. By integrating visual perception, language understanding, and action planning, they enable general-purpose task execution across diverse environments. Despite their importance, the security of VLA models remains underexplored -- particularly in the context of backdoor attacks, which pose realistic threats in physical-world deployments. While recent methods attempt to inject backdoors into VLA models, these backdoors are easily erased during downstream adaptation, as user-side fine-tuning with clean data significantly alters model parameters, rendering them impractical for real-world applications. To address these challenges, we propose INFUSE (INjection into Fine-tUne-inSensitive modulEs), the first backdoor attack framework for VLA base models that remains effective even with arbitrary user fine-tuning. INFUSE begins by analyzing parameter sensitivity across diverse fine-tuning scenarios to identify modules that remain largely unchanged -- the fine-tune-insensitive modules. It then injects backdoors into these stable modules while freezing the rest, ensuring malicious behavior persists after extensive user fine-tuning. Comprehensive experiments across multiple VLA architectures demonstrate INFUSE's effectiveness. After user-side fine-tuning, INFUSE maintains mean attack success rates of 91.0% on simulation environments and 79.8% on real-world robot tasks, substantially surpassing BadVLA (38.8% and 36.6%, respectively), while preserving clean-task performance comparable to standard models. These results uncover a critical threat: backdoors implanted before distribution can persist through fine-tuning and remain effective at deployment.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Safety and adversarial attacks, one of 13 directions in Vision-language-action models. Builds on 40 of its 50 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
40 of 50 references.
Closest ancestors · 2
Same direction, newest first
- 2025BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimization22 May
- 2024Manipulation Facing Threats: Evaluating Physical Vulnerabilities in End-to-End Vision Language Action Models20 Sep
Other references · 38
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
26 more
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
- 2024Dissecting Adversarial Robustness of Multimodal LM Agentscited by 118
- 2021Backdoor Attacks on Pre-trained Models by Layerwise Weight Poisoningcited by 103
- 2024CoVLA: Comprehensive Vision-Language-Action Dataset for Autonomous Drivingcited by 74
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 72
- 2024A Survey on Robotics with Foundation Models: toward Embodied AIcited by 53
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 50
- 2024Revisiting Backdoor Attacks against Large Vision-Language Models from Domain Shiftcited by 45
- 2024VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulationcited by 43
- 2024BadRobot: Jailbreaking Embodied LLM Agents in the Physical Worldcited by 40
- 2024TrojVLM: Backdoor Attack Against Vision Language Modelscited by 35
- 2025MoManipVLA: Transferring Vision-language-action Models for General Mobile Manipulationcited by 34
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 32
- 2025UAV-VLA: Vision-Language-Action System for Large Scale Aerial Mission Generationcited by 27
- 2022Friendly Noise against Adversarial Noise: A Powerful Defense against Data Poisoning Attackscited by 20
- 2025Natural Reflection Backdoor Attack on Vision Language Model for Autonomous Drivingcited by 16
- 2022Compression-Resistant Backdoor Attack against Deep Neural Networkscited by 14
- 2025Backdoor Attack on Vision Language Models with Stealthy Semantic Manipulationcited by 13
- 2025Robust Anti-Backdoor Instruction Tuning in LVLMscited by 10
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunitiescited by 9
- 2025Multimodal Data Storage and Retrieval for Embodied AI: A Surveycited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026TRAP: Tail-aware Ranking Attack for World-Model Planningcited by 4
- 2026VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijackingcited by 3
- 2026Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluationcited by 2
- 2026Lights, Camera, Malfunction: When Illumination Robustness Leaves VLA Models Blind to Colorcited by 1
- 2026TrustVLA: Mechanism-Guided Inference-Time Defense Against Vision-Language-Action Backdoorscited by 0
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluationcited by 0
- 2026When the World Lies: Backdoor Attacks on Latent World Models for Downstream Controlcited by 0
- 2026When the World Lies: Backdoor Attacks on Latent World Models for Downstream Control14 Sep 2026
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation17 Aug 2026
- 2026Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation30 Jul 2026
- 2026Lights, Camera, Malfunction: When Illumination Robustness Leaves VLA Models Blind to Color16 Jul 2026
- 2026TrustVLA: Mechanism-Guided Inference-Time Defense Against Vision-Language-Action Backdoors14 Jul 2026
- 2026VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijacking27 May 2026
- 2026TRAP: Tail-aware Ranking Attack for World-Model Planning3 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025DropVLA: An Action-Level Backdoor Attack on Vision-Language-Action Models
- 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Models
- 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Space
- 2025BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models
- 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects
- 2026Phantasia: Context-Adaptive Backdoors in Vision Language Models
- 2026When Attention Betrays: Erasing Backdoor Attacks in Robotic Policies by Reconstructing Visual Tokens
- 2026TMT: Runtime Backdoor Detection for Vision-Language-Action Policies on Unseen Tasks