When Experience Becomes Instruction: Trajectory Poisoning in Self-Evolving Agent Skill Systems
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Self-evolving skill (SES) systems distill agent trajectories into persistent skills, allowing untrusted experience to become trusted instruction. We introduce PoisonedEvolution, a trajectory-poisoning attack on this promotion process. Our skill-visible black-box attacker can inspect a target skill and contribute bounded evidence, but cannot observe private pools or evolution logic or edit the skill bank. Artifact poisoning requires Inclusion, Evolution Attribution, and Realization. Attribution is the distinctive bottleneck: the target behavior must appear causally useful, recurrent, and generalizable before promotion. We evaluate four representative security-effect families using inert canary specifications. At 10% attacker support, across six mainstream LLM evolvers in SkillClaw, PoisonedEvolution embeds target behaviors in 546/600 trials (91.0% SER). On the structurally different Trace2Skill pipeline at the same ratio, it embeds target behaviors in 369/600 trials (61.5% SER), demonstrating transfer across evolution architectures. In a representative controlled study, three consistent attacker records suffice in a 30-record batch, whereas a single record is much weaker. Ablations identify recurring support, causal framing, and domain-aligned encoding as the main determinants of success. These findings expose evidence promotion as a security boundary for self-evolving agents.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 18 of its 24 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
18 of 24 references.
Closest ancestors · 6
Same direction, newest first
- 2026Poise: Position-Aware One-Instruction Skill Injection for Silent Execution on LLM Agents6 Jun
- 2026RouteGuard: Internal-Signal Detection of Skill Poisoning in LLM Agents24 Apr
- 2026Supply-Chain Poisoning Attacks Against LLM Coding Agent Skill Ecosystems3 Apr
- 2026Poison Once, Exploit Forever: Environment-Injected Memory Poisoning Attacks on Web Agents3 Apr
- 2026Skill-Inject: Measuring Agent Vulnerability to Skill File Attacks23 Feb
- 2025Defeating Prompt Injections by Design24 Mar
Other references · 12
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
- 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 179
- 2026Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skillscited by 161
- 2026MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agentscited by 129
- 2026CoEvoSkills: Self-Evolving Agent Skills via Co-Evolutionary Verificationcited by 117
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 105
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
- 2026SkillClaw: Let Skills Evolve Collectively with Agentic Evolvercited by 76
- 2026BadSkill: Backdoor Attacks on Agent Skills via Model-in-Skill Poisoningcited by 25
- 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluationcited by 23
- 2026Model Context Protocol Threat Modeling and Analyzing Vulnerabilities to Prompt Injection with Tool Poisoningcited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Query-Only Backdoor Attacks on Self-Evolving Skills via Trajectory Poisoning
- 2026SkillPoison: Progressive Skill Poisoning via Successful Experiences
- 2026When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents
- 2026Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents
- 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystems
- 2026EvoSkill Injection: Red-Teaming Autonomous Skill Generation and Evolution in Self-Evolving Agents
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds
- 2026Hiding in Plain Sight: Decoupling Pretext from Actuation for Skill Poisoning in LLM Agents