SkillsMetric: Mapping the Detection Boundary of Static Analysis for Malicious Agent Skills
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Agent Skills---structured packages of instructions and scripts that augment LLM-based agents---are rapidly proliferating, yet their security properties remain under-explored. We present textscSkillsMetric, a five-stage static analysis framework that scores skill packages along pattern density, statistical anomaly, dataflow taint, import anomaly, and capability mismatch dimensions. We construct an adversarial evaluation dataset of 2,266 skills spanning 16~attack types across code-level, system-level, and semantic-level threats, and evaluate on the full SkillMD-138K corpus. Our framework achieves an AUC of 0.93 and 5-fold cross-validated F1 of 73.4%±0.5%, with strong detection of data exfiltration (93%) and steganographic payloads (93%). Crucially, we identify fundamental blind spots: host destruction attacks using common shell commands evade all five stages (0% detection), and prompt injection via natural-language manipulation achieves only 42% detection. These findings establish that static analysis alone is insufficient for skill security, motivating defense-in-depth architectures that combine fast static pre-screening with semantic review.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 1 of its 5 references that are in the map. First posted on arXiv 9 Aug 2026.
Builds on
1 of 5 references.
References · 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MaliciousSkillBench: A Comprehensive Benchmark for Malicious Agent Skill Detection
- 2026SkillSieve: A Hierarchical Triage Framework for Detecting Malicious AI Agent Skills
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale
- 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks
- 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wild
- 2026Pretext: Defeating Malicious Skill Detection Frameworks for AI Agents
- 2026Towards a Risk Assessment of Malicious Skill Files in Coding Agents
- 2026SkillAttack: Automated Red Teaming of Agent Skills through Attack Path Refinement