Context Matters: Repository-Aware Security Analysis of the Agent Skill Ecosystem
Not on the map. Why?
Abstract (arXiv)
Agent skills extend local AI agents, such as Claude Code and OpenClaw, with additional functionality. Their growing popularity has led to dedicated marketplaces resembling mobile app stores, as well as automated scanners that assess whether skills are benign or malicious. However, scanner reports from individual marketplaces classify up to 46.8% of skills as malicious, raising concerns about false positives. We present the largest empirical security analysis of the AI agent skill ecosystem to date. We collect 238,180 unique skills from three major distribution platforms and GitHub, and analyze their contents, behavior, and repository context. Unlike existing scanner-based assessments, which evaluate skills largely in isolation, our repository-aware analysis checks whether a flagged skill is consistent with its surrounding GitHub project. This context substantially reduces the number of suspicious skills: only 0.52% remain suspicious after repository-aware analysis. Our results show that existing scanners can substantially overestimate maliciousness when repository context is ignored. At the same time, we identify previously undocumented real-world attack vectors, including the hijacking of skills hosted in abandoned GitHub repositories. Overall, our findings provide a more robust view of the agent-skill ecosystem's current risk surface and highlight the need for context-aware security evaluation.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 8 of its 30 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
8 of 30 references.
References · 8
- 2024AI Agents Under Threat: A Survey of Key Security Challenges and Future Pathwayscited by 127
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scalecited by 105
- 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attackscited by 90
- 2026Agent Skills: A Data-Driven Analysis of Claude Skills for Extending Large Language Model Functionalitycited by 72
- 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wildcited by 50
- 2026Formal Analysis and Supply Chain Security for Agentic AI Skillscited by 25
- 2023Killing Two Birds with One Stone: Malicious Package Detection in NPM and PyPI using a Single Model of Malicious Behavior Sequencecited by 9
- 2026Supply Chain Insecurity: Exposing Vulnerabilities in iOS Dependency Management Systemscited by 1
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registrycited by 12
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skillscited by 7
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Librariescited by 6
- 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skillscited by 5
- 2026Seeing Is Not Screening: Multimodal Hidden Instruction Attacks on Agent Skill Scannerscited by 5
- 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystemscited by 2
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Networkcited by 1
- 2026SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scalecited by 1
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systemscited by 0
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Securitycited by 0
- 2026Surviving the Router: Optimizing Skill Injections for Retrieval and Executioncited by 0
- 2026Surviving the Router: Optimizing Skill Injections for Retrieval and Execution6 Oct 2026
- 2026SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale30 Sep 2026
- 2026Towards a Systems Foundation for Agentic Skills: Architecture, Lifecycle, and Security30 Aug 2026
- 2026Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries11 Jul 2026
- 2026Seeing Is Not Screening: Multimodal Hidden Instruction Attacks on Agent Skill Scanners16 Jun 2026
- 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skills12 Jun 2026
- 2026Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Network25 May 2026
- 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystems12 May 2026
- 2026Under the Hood of SKILL.md: Semantic Supply-chain Attacks on AI Agent Skill Registry12 May 2026
- 2026Structured Security Auditing and Robustness Enhancement for Untrusted Agent Skills28 Apr 2026
- 2026OpenClaw and Ollama in Agentic AI: Toward Fully Autonomous and Scalable AI Agent Systems16 Apr 2026