EVOMAL: Self-Poisoning in Self-Evolving Coding Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Self-evolving LLM coding agents write their own tools by imitating retrieved skills from shared skill libraries. We identify a vulnerability in this loop: during authoring, a retrieved malicious skill can become the template for a new skill that preserves the payload. We call this self-poisoning: the agent authors, stores, and runs the resulting malicious skill. We exploit it through EvoMal, an attack that amplifies self-poisoning by wrapping an interchangeable payload in a banner, a set of benign-looking structural elements that induces an imitating agent to reproduce the enclosed code. The attacker plants malicious skills in the library without invoking them. The agent then authors and executes new skills carrying the harmful code. Each authored copy can re-enter the library and be imitated again, forming a self-propagating worm that persists after the planted skills are removed. We define the agent self-poisoning rate (ASPR) as the fraction of tasks that add a newly authored malicious skill to the library. Across six models on 153 tool-relevant SWE-bench Verified tasks, ASPR ranges from 20.3% to 41.8%, and the poisoned libraries hold 4.9 to 9.0 times as many malicious skills as were planted. The vulnerability also appears without a banner: DeepSeek-V4-Pro reaches 11.1% ASPR with the payload alone. Tailoring the planted skill descriptions to one task family raises ASPR to 86.7%. After the planted skills are removed, Qwen3 retains a round-5 ASPR of 68% because agent-authored copies remain. These copies evade existing defenses, which focus on attacker-submitted names, code, and signatures. We propose counter-prompt, a defense that discourages banner-style copying and reduces EvoMal's ASPR to at most 6.7% with no significant task-completion loss.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 47 of its 72 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
47 of 72 references.
Closest ancestors · 21
Same direction, newest first
- 2026Safety in Self-Evolving LLM Agent Systems: Threats, Amplification, and Case Studies22 Jun
- 2026OEP: Poisoning Self-Evolving LLM Agents via Locally Correct but Non-Transferable Experiences18 May
- 2026On Safety Risks in Experience-Driven Self-Evolving Agents18 Apr
- 2026SkillTrojan: Backdoor Attacks on Skill-Based Agent Systems8 Apr
- 2026Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystems3 Apr
- 2026AgentWorm: Self-Propagating Attacks Across LLM Agent Ecosystems16 Mar
- 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey11 Mar
- 2026Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injections17 Feb
- 2026MalTool: Malicious Tool Attacks on LLM Agents12 Feb
- 2026"Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wild6 Feb
- 2026Prompt Injection Attacks on Agentic Coding Assistants: A Systematic Analysis of Vulnerabilities in Skills, Tools, and Protocol Ecosystems24 Jan
- 2026Agent Skills in the Wild: An Empirical Study of Security Vulnerabilities at Scale15 Jan
9 more
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents30 Sep
- 2025MCP-Guard: A Multi-Stage Defense-in-Depth Framework for Securing Model Context Protocol in Agentic AI14 Aug
- 2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents30 Jun
- 2025LlamaFirewall: An open source guardrail system for building secure AI agents6 May
- 2025Prompt Injection Attack to Tool Selection in LLM Agents28 Apr
- 2025Progent: Securing AI Agents with Privilege Control16 Apr
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun
Other references · 26
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
14 more
- 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 431
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 279
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 170
- 2024Certifiably Robust RAG against Retrieval Corruptioncited by 151
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 128
- 2025Reinforcement Learning for Self-Improving Agent with Skill Librarycited by 100
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?cited by 95
- 2026Qwen3-Coder-Next Technical Reportcited by 71
- 2024Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applicationscited by 59
- 2026BadSkill: Backdoor Attacks on Agent Skills via Model-in-Skill Poisoningcited by 27
- 2025Anatomy of a Machine Learning Ecosystem: 2 Million Models on Hugging Facecited by 12
- 2026SkillJack: Persistent Skill Backdoors in Self-Evolving Agentscited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026SkillPoison: Progressive Skill Poisoning via Successful Experiencescited by 1
- 2026Share-Borne AI Virus: Memory-Hopping Attacks Across LLM Agentscited by 0
- 2026Self-Evolving Agent Harnesscited by 0
- 2026Self-Evolving Agent Harness13 Oct 2026
- 2026SkillPoison: Progressive Skill Poisoning via Successful Experiences6 Oct 2026
- 2026Share-Borne AI Virus: Memory-Hopping Attacks Across LLM Agents28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026SkillBloat: Token Amplification Attacks via Skill Injection in LLM Coding Agents
- 2026PhantomSkill: Malicious Code Injection in Agent Skill Ecosystems
- 2026Towards a Risk Assessment of Malicious Skill Files in Coding Agents
- 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystems
- 2026When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systems
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents
- 2026SkillDRE: Dual-Stage Red-Team Evolution of Agent Skills via Pre-Execution and Runtime Feedback
- 2026TRACE: Task-Aware Adaptive Self-Evolving Agentic Jailbreaking