mlsanityData to 14 Oct 2026

Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale

arXiv 2601.10338 ↗First posted 15 Jan 2026cs.CR cs.AI cs.CLcited by 105

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

The rise of AI agent frameworks has introduced agent skills, modular packages containing instructions and executable code that dynamically extend agent capabilities. While this architecture enables powerful customization, skills execute with implicit trust and minimal vetting, creating a significant yet uncharacterized attack surface. We conduct the first large-scale empirical security analysis of this emerging ecosystem, collecting 42,447 skills from two major marketplaces and systematically analyzing 31,132 using SkillScan, a multi-stage detection framework integrating static analysis with LLM-based semantic classification. Our findings reveal pervasive security risks: 26.1% of skills contain at least one vulnerability, spanning 14 distinct patterns across four categories: prompt injection, data exfiltration, privilege escalation, and supply chain risks. Data exfiltration (13.3%) and privilege escalation (11.8%) are most prevalent, while 5.2% of skills exhibit high-severity patterns strongly suggesting malicious intent. We find that skills bundling executable scripts are 2.12x more likely to contain vulnerabilities than instruction-only skills (OR=2.12, p<0.001). Our contributions include: (1) a grounded vulnerability taxonomy derived from 8,126 vulnerable skills, (2) a validated detection methodology achieving 86.7% precision and 82.5% recall, and (3) an open dataset and detection toolkit to support future research. These results demonstrate an urgent need for capability-based permission systems and mandatory security vetting before this attack vector is further exploited.

Key facts. Cited by 105 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 6 of its 34 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

6 of 34 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections30 Oct

Other references · 5

  1. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
  2. 2020Backstabber's Knife Collection: A Review of Open Source Software Supply Chain Attackscited by 61
  3. 2023Killing Two Birds with One Stone: Malicious Package Detection in NPM and PyPI using a Single Model of Malicious Behavior Sequencecited by 9
  4. 2024Developers Are Victims Too : A Comprehensive Analysis of The VS Code Extension Ecosystemcited by 4
  5. 2025A Study on Malicious Browser Extensions in 2025cited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 105.

105 papers.

Sort:

By area:

  1. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 113
  2. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
  3. 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 72
  4. 2026SkillNet: Create, Evaluate, and Connect AI Skillscited by 53
  5. 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wildcited by 50
  6. 2026Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystemscited by 45
  7. 2026SkillReducer: Optimizing LLM Agent Skills for Token Efficiencycited by 33
  8. 2026ClawsBench: Evaluating Capability and Safety of LLM Productivity Agents in Simulated Workspacescited by 33
  9. 2026SkillAttack: Automated Red Teaming of Agent Skills through Attack Path Refinementcited by 30
  10. 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threatscited by 29
  11. 2026SkillJect: Effectively Automating Skill-Based Prompt Injection for Skill-Enabled Agentscited by 25
  12. 2026Formal Analysis and Supply Chain Security for Agentic AI Skillscited by 25
38 more
  1. 2026SkillProbe: Security Auditing for Emerging Agent Skill Marketplaces via Multi-Agent Collaborationcited by 21
  2. 2026Your Agent, Their Asset: A Real-World Safety Analysis of OpenClawcited by 20
  3. 2026SkillSieve: A Hierarchical Triage Framework for Detecting Malicious AI Agent Skillscited by 20
  4. 2026How Your Credentials Are Leaked by LLM Agent Skills: An Empirical Studycited by 19
  5. 2026SkillSafetyBench: Evaluating Agent Safety under Skill-Facing Attack Surfacescited by 19
  6. 2026MalSkillBench: A Runtime-Verified Benchmark of Malicious Agent Skillscited by 19
  7. 2026When Safe Skills Collide: Measuring Compositional Risk in Agent Skill Ecosystemscited by 17
  8. 2026From Skill Text to Skill Structure: The Scheduling-Structural-Logical Representation for Agent Skillscited by 16
  9. 2026Towards Secure Agent Skills: Architecture, Threat Taxonomy, and Security Analysiscited by 13
  10. 2026Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chaincited by 13
  11. 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registrycited by 12
  12. 2026AgentTrap: Measuring Runtime Trust Failures in Third-Party Agent Skillscited by 12
  13. 2026Context Matters: Repository-Aware Security Analysis of the Agent Skill Ecosystemcited by 11
  14. 2026Cloak and Detonate: Scanner Evasion and Dynamic Detection of Agent Skill Malwarecited by 10
  15. 2026VIGIL: Runtime Enforcement of Behavioral Specifications in AI Agent Skillscited by 9
  16. 2026Trojan's Whisper: Stealthy Manipulation of OpenClaw through Injected Bootstrapped Guidancecited by 8
  17. 2026RouteGuard: Internal-Signal Detection of Skill Poisoning in LLM Agentscited by 7
  18. 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skillscited by 7
  19. 2026Safety in Embodied AI: A Survey of Risks, Attacks, and Defensescited by 7
  20. 2026Exploiting LLM Agent Supply Chains via Payload-less Skillscited by 6
  21. 2026SkillHarm: Lifecycle-Aware Skill-Based Attacks via Automated Constructioncited by 6
  22. 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
  23. 2026Generative Skill Composition for LLM Agentscited by 6
  24. 2026From Anatomy to Smells: An Empirical Study of SKILL.md in Agent Skillscited by 6
  25. 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
  26. 2026MalSkills: Detecting Malicious Skills in the Agentic Supply Chain via Neuro-symbolic Reasoningcited by 5
  27. 2026SkillScope: Toward Fine-Grained Least-Privilege Enforcement for Agent Skillscited by 5
  28. 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system securitycited by 5
  29. 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skillscited by 5
  30. 2026Seeing Is Not Screening: Multimodal Hidden Instruction Attacks on Agent Skill Scannerscited by 5
  31. 2026Agent Skill Security: Threat Models, Attacks, Defenses, and Evaluationcited by 5
  32. 2026Bilevel Optimization of Agent Skills via Monte Carlo Tree Searchcited by 4
  33. 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scannerscited by 4
  34. 2026Agent Skill Framework: Perspectives on the Potential of Small to Medium Language Models in Industrial Environmentscited by 3
  35. 2026Defenses & Enablers For Skill Injection Attacks on Terminal Based Agentscited by 3
  36. 2026Runtime Skill Audit: Targeted Runtime Probing for Agent Skill Securitycited by 3
  37. 2026Skills Are Not Islands: Measuring Dependency and Risk in Agent Skill Supply Chainscited by 3
  38. 2026OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skillscited by 3

50 most cited of 105 All 105 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards a Risk Assessment of Malicious Skill Files in Coding Agents
  2. 2026SkillsMetric: Mapping the Detection Boundary of Static Analysis for Malicious Agent Skills
  3. 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks
  4. 2026Behavioral Integrity Verification for AI Agent Skills
  5. 2026Technical Report: Exploring the Emerging Threats of the Agent Skill Ecosystem
  6. 2026SkillTrojan: Backdoor Attacks on Skill-Based Agent Systems
  7. 2026Benchmarking Security Risk Detection and Verification in Open Agentic Skill Ecosystems
  8. 2026Can Agents Trust Their Skills? Uncovering Unsafe Chains of Trust in Skill-Based LLM Agents