mlsanityData to 7 Oct 2026

BadSkill: Backdoor Attacks on Agent Skills via Model-in-Skill Poisoning

arXiv 2604.09378 ↗First posted 10 Apr 2026cs.CR cs.AIcited by 25

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Agent ecosystems increasingly rely on installable skills to extend functionality, and some skills bundle learned model artifacts as part of their execution logic. This creates a supply-chain risk that is not captured by prompt injection or ordinary plugin misuse: a third-party skill may appear benign while concealing malicious behavior inside its bundled model. We present BadSkill, a backdoor attack formulation that targets this model-in-skill threat surface. In BadSkill, an adversary publishes a seemingly benign skill whose embedded model is backdoor-fine-tuned to activate a hidden payload only when routine skill parameters satisfy attacker-chosen semantic trigger combinations. To realize this attack, we train the embedded classifier with a composite objective that combines classification loss, margin-based separation, and poison-focused optimization, and evaluate it in an OpenClaw-inspired simulation environment that preserves third-party skill installation and execution while enabling controlled multi-model study. Our benchmark spans 13 skills, including 8 triggered tasks and 5 non-trigger control skills, with a combined main evaluation set of 571 negative-class queries and 396 trigger-aligned queries. Across eight architectures (494M--7.1B parameters) from five model families, BadSkill achieves up to 99.5% average attack success rate (ASR) across the eight triggered skills while maintaining strong benign-side accuracy on negative-class queries. In poison-rate sweeps on the standard test split, a 3% poison rate already yields 91.7% ASR. The attack remains effective across the evaluated model scales and under five text perturbation types. These findings identify model-bearing skills as a distinct model supply-chain risk in agent ecosystems and motivate stronger provenance verification and behavioral vetting for third-party skill artifacts.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 31 of its 35 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

31 of 35 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
  2. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul

Other references · 29

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2023Qwen Technical Reportcited by 3,273
  4. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  5. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  6. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  7. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  8. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  9. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  10. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
  11. 2024Yi: Open Foundation Models by 01.AIcited by 706
  12. 2024Phi-4 Technical Reportcited by 675
17 more
  1. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
  2. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
  3. 2020Backdoor Learning: A Surveycited by 412
  4. 2024InternLM2 Technical Reportcited by 391
  5. 2020Weight Poisoning Attacks on Pre-trained Modelscited by 318
  6. 2017Certified Defenses for Data Poisoning Attackscited by 288
  7. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 268
  8. 2023Poisoning Language Models During Instruction Tuningcited by 254
  9. 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Triggercited by 203
  10. 2020BadNL: Backdoor Attacks against NLP Models with Semantic-preserving Improvementscited by 191
  11. 2020Dataset Security for Machine Learning: Data Poisoning, Backdoor Attacks, and Defensescited by 171
  12. 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 143
  13. 2023Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Modelscited by 100
  14. 2024ToolSword: Unveiling Safety Issues of Large Language Models in Tool Learning Across Three Stagescited by 77
  15. 2024Instruction Backdoor Attacks Against Customized LLMscited by 50
  16. 2024A Study of Backdoors in Instruction Fine-tuned Language Modelscited by 11
  17. 2022The Dark Side of the Language: Pre-trained Transformers in the DarkNetcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 25.

25 papers.

Sort:

By area:

  1. 2026SkillSafetyBench: Evaluating Agent Safety under Skill-Facing Attack Surfacescited by 15
  2. 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystemscited by 14
  3. 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registrycited by 10
  4. 2026AgentTrap: Measuring Runtime Trust Failures in Third-Party Agent Skillscited by 9
  5. 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 9
  6. 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
  7. 2026BraveGuard: From Open-World Threats to Safer Computer-Use Agentscited by 4
  8. 2026SkillHarm: Lifecycle-Aware Skill-Based Attacks via Automated Constructioncited by 4
  9. 2026SkillGuard: A Permission-Centric Framework for Agent Skill Securitycited by 4
  10. 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scannerscited by 3
  11. 2026SLBench: Evaluating How LLM Agents Follow Logical Relations in Skillscited by 2
  12. 2026Convergent Detour Hijacking: Task-Preserving Resource Amplification in Skill-Based LLM Agentscited by 2
13 more
  1. 2026CompoSkill: Compositional Skill Chain Attacks from Individually Scanner-Passing LLM Agent Skillscited by 2
  2. 2026Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasurescited by 1
  3. 2026When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systemscited by 1
  4. 2026EVOMAL: Self-Poisoning in Self-Evolving Coding Agentscited by 1
  5. 2026Query-Only Backdoor Attacks on Self-Evolving Skills via Trajectory Poisoningcited by 0
  6. 2026ElasticBack: Stealthy Conditional Backdoor in LLM-Agent Skills via Coupled Trigger-Rule Optimizationcited by 0
  7. 2026Beyond Handcrafted Security: Towards Self-Evolving Defense for LLM Agentscited by 0
  8. 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Securitycited by 0
  9. 2026EvoSkill Injection: Red-Teaming Autonomous Skill Generation and Evolution in Self-Evolving Agentscited by 0
  10. 2026Versioned Transitive Dependency-Closure Binding and Operation-Time Effect Governance for Agent Skills: ClosureBoundcited by 0
  11. 2026SkillSpec: Intent-Masked Specification Reasoning for Agent Skill Correctnesscited by 0
  12. 2026Stealth Apart, Harm Together: Skill Cascading Attacks on Skill-Based Agent Systemscited by 0
  13. 2026Hiding in Plain Sight: Decoupling Pretext from Actuation for Skill Poisoning in LLM Agentscited by 0