Pretext: Defeating Malicious Skill Detection Frameworks for AI Agents
On the map: LLM agents and tool use → Agent skill learning and evolution also fits: Agent threats, guardrails and governance
Abstract (arXiv)
Skills extend an agent's capabilities by injecting instructions and information into the context, and are widely used by agents such as OpenClaw and Claude Code. Prior work shows third-party marketplaces host malicious skills that give attackers direct influence over the victim's agent. The emerging defense scans skills before installation, pairing deterministic static checks with an LLM-based semantic judge, as in NVIDIA's SkillSpector. We show that such defenses fall to an attacker who knows the detector. Our white-box LLM attacker, Pretext, iteratively crafts skills that evade detection while still delivering the payload and performing the benign task: moving the payload from code into natural language leaves static analysis inert, while framing it as the skill's legitimate purpose and splitting instructions across files keeps the LLM stage below its blocking threshold. Across three open-source models, Pretext achieves up to 97% and 77% against a frozen detector and a co-adaptive one, respectively, revealing major gaps in current skill scanners.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent skill learning and evolution, one of 16 directions in LLM agents and tool use. Builds on 9 of its 23 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
9 of 23 references.
References · 9
- 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wildcited by 46
- 2026Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystemscited by 42
- 2026SkillAttack: Automated Red Teaming of Agent Skills through Attack Path Refinementcited by 24
- 2026SkillTrojan: Backdoor Attacks on Skill-Based Agent Systemscited by 21
- 2026SkillJect: Effectively Automating Skill-Based Prompt Injection for Skill-Enabled Agentscited by 20
- 2026SkillSieve: A Hierarchical Triage Framework for Detecting Malicious AI Agent Skillscited by 18
- 2026Defensive Refusal Bias: How Safety Alignment Fails Cyber Defenderscited by 10
- 2026Detecting Malicious Agent Skills in the Wild using Attentioncited by 6
- 2026SkillGate: Cost Efficient Runtime Malicious Skill File Detection in Coding Agentscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SkillsMetric: Mapping the Detection Boundary of Static Analysis for Malicious Agent Skills
- 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skills
- 2026SkillSecurer: Detecting and Patching Prompt-Injection Vulnerabilities in AI Agent Skills
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale
- 2026Behavioral Integrity Verification for AI Agent Skills
- 2026Black-Box Skill Stealing Attack from Proprietary LLM Agents: An Empirical Study
- 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks
- 2026ColluSkill: Adversarial Cross-Skill Composition for Evading Agent Skill Scanners