mlsanityData to 7 Oct 2026

Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injections

arXiv 2602.15654 ↗First posted 17 Feb 2026cs.CR cs.AIcited by 44

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

Self-evolving LLM agents update their internal state across sessions, often by writing and reusing long-term memory. This design improves performance on long-horizon tasks but creates a security risk: untrusted external content observed during a benign session can be stored as memory and later treated as instruction. We study this risk and formalize a persistent attack we call a Zombie Agent, where an attacker covertly implants a payload that survives across sessions, effectively turning the agent into a puppet of the attacker. We present a black-box attack framework that uses only indirect exposure through attacker-controlled web content. The attack has two phases. During infection, the agent reads a poisoned source while completing a benign task and writes the payload into long-term memory through its normal update process. During trigger, the payload is retrieved or carried forward and causes unauthorized tool behavior. We design mechanism-specific persistence strategies for common memory implementations, including sliding-window and retrieval-augmented memory, to resist truncation and relevance filtering. We evaluate the attack on representative agent setups and tasks, measuring both persistence over time and the ability to induce unauthorized actions while preserving benign task quality. Our results show that memory evolution can convert one-time indirect injection into persistent compromise, which suggests that defenses focused only on per-session prompt filtering are not sufficient for self-evolving agents.

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 25 of its 32 references that are in the map. First posted on arXiv 17 Feb 2026.

Builds on

25 of 32 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrieval18 Dec
  2. 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agents30 Sep

Other references · 23

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  3. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  4. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  5. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  6. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  7. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 328
  8. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
  9. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
  10. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  11. 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agentscited by 66
  12. 2024Self-evolving Agents with reflective and memory-augmented abilitiescited by 52
11 more
  1. 2025Can Indirect Prompt Injection Attacks Be Detected and Removed?cited by 43
  2. 2025EvoTest: Evolutionary Test-Time Learning for Self-Improving Agentic Systemscited by 34
  3. 2024Defense Against Prompt Injection Attack by Leveraging Attack Techniquescited by 31
  4. 2025One Shot Dominance: Knowledge Poisoning Attack on Retrieval-Augmented Generation Systemscited by 28
  5. 2025Evaluating the Paperclip Maximizer: Are RL-Based Language Models More Likely to Pursue Instrumental Goals?cited by 26
  6. 2024Backdoored Retrievers for Prompt Injection Attacks on Retrieval Augmented Generation of Large Language Modelscited by 21
  7. 2025CPA-RAG:Covert Poisoning Attacks on Retrieval-Augmented Generation in Large Language Modelscited by 17
  8. 2026Just-In-Time Reinforcement Learning: Continual Learning in LLM Agents Without Gradient Updatescited by 17
  9. 2025Robustness via Referencing: Defending against Prompt Injection Attacks by Referencing the Executed Instructioncited by 15
  10. 2025Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidancecited by 14
  11. 2026EvoClinician: A Self-Evolving Agent for Multi-Turn Medical Diagnosis via Test-Time Evolutionary Learningcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 44.

44 papers.

Sort:

By area:

  1. 2026A Survey on Long-Term Memory Security in LLM Agents: Attacks, Defenses, and Governance Across the Memory Lifecyclecited by 21
  2. 2026Your Agent, Their Asset: A Real-World Safety Analysis of OpenClawcited by 19
  3. 2026MemLineage: Lineage-Guided Enforcement for LLM Agent Memorycited by 14
  4. 2026OEP: Poisoning Self-Evolving LLM Agents via Locally Correct but Non-Transferable Experiencescited by 9
  5. 2026Forget to Improve: On-Device LLM-Agent Continual Learning via Budget-Curated Memorycited by 8
  6. 2026Safety in Self-Evolving LLM Agent Systems: Threats, Amplification, and Case Studiescited by 6
  7. 2026When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundarycited by 6
  8. 2026Injection-Execution Dissociation: A Mechanistic Evaluation of Persistent Memory Attacks and Defenses in Stateful LLM Agentscited by 5
  9. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 5
  10. 2026Bad Memory: Evaluating Prompt Injection Risks from Memory in Agentic Systemscited by 5
  11. 2026What If Prompt Injection Never Left? Rethinking Agent Security through Cross-Session Stored Prompt Injectioncited by 3
  12. 2026When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agentscited by 3
32 more
  1. 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agentscited by 3
  2. 2026Mind Viruses: Self-Propagating Ideas in Multi-Agent LLM Systemscited by 3
  3. 2026InjecMEM: Memory Injection Attack on LLM Agent Memory Systemscited by 3
  4. 2026Why Agents Compromise Safety Under Pressurecited by 2
  5. 2026The Authorization-Execution Gap Is a Major Safety and Security Problem in Open-World Agentscited by 2
  6. 2026Forensic Trajectory Signatures for Agent Memory Poisoning Detectioncited by 2
  7. 2026Benign Alone, Harmful Together: Exploiting Experience Composition in Self-Evolving LLM Agentscited by 2
  8. 2026When Convenience Becomes Risk: A Semantic View of Under-Specification in Host-Acting Agentscited by 1
  9. 2026Kill-Chain Canaries: Stage-Level Tracking of Prompt Injection Across Attack Surfaces and Model Safety Tierscited by 1
  10. 2026When Routine Chats Turn Toxic: Unintended Long-Term State Poisoning in Personalized Agentscited by 1
  11. 2026Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasurescited by 1
  12. 2026Plant, Persist, Trigger: Sleeper Attack on Large Language Model Agentscited by 1
  13. 2026HarnessSafe: Evaluating Safety Across Persistent Carriers in Agent Harnessescited by 1
  14. 2026EVOMAL: Self-Poisoning in Self-Evolving Coding Agentscited by 1
  15. 2026ShadowMerge: A Novel Poisoning Attack on Graph-Based Agent Memory via Relation-Channel Conflictscited by 0
  16. 2026Ghost in the Context: Policy-Carriage Integrity in LLM Agentscited by 0
  17. 2026Inverting the Shield: Systematically Generating Safety Tests from Policy Specificationscited by 0
  18. 2026RT-SHCUA: Real-Time Self-Hosted Computer-Use Agent for UAV Controlcited by 0
  19. 2026Salami Attack: Stealthy Collusive Memory Poisoning against OpenClawcited by 0
  20. 2026Query-Only Backdoor Attacks on Self-Evolving Skills via Trajectory Poisoningcited by 0
  21. 2026EvoUndo: Recoverability-Constrained Self-Evolution for LLM Agent Harnessescited by 0
  22. 2026Understanding Stage-Wise Utility-Risk Trade-offs in LLM Agent Memorycited by 0
  23. 2026Transferable End-to-End Optimization for Indirect Long-Term Memory Poisoning in LLM Agentscited by 0
  24. 2026Revoked but Still Authoritative: An Empirical Study of Revocation Enforcement in Agent-Memory Systemscited by 0
  25. 2026Reflections on Trusting Trust, Revisited: Contaminating Self-Modifying AI Coding Agents with Poisoned Benchmarkscited by 0
  26. 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
  27. 2026Evolutionary Safety of Recursive Self-Improving AI: Taxonomy, Risk Discovery, and Evaluationcited by 0
  28. 2026Compositional Safety Failures in Harness Evolution: Identification and Runtime Monitoringcited by 0
  29. 2026When Consent Outlives Context: Residual Authority Replay in Long-Lived Agentscited by 0
  30. 2026Share-Borne AI Virus: Memory-Hopping Attacks Across LLM Agentscited by 0
  31. 2026SEABench: Benchmarking Endogenous Misalignment In Self-Evolving Agentscited by 0
  32. 2026Visual Memory Attacks Can Persist Through The KV Cachecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026MemSecBench: Tracking Agent Memory Poisoning from Persistence to Consequence and Repair
  2. 2026AgentSys: Secure and Dynamic LLM Agents Through Explicit Hierarchical Memory Management
  3. 2026From Attack Success to Attack Severity: Counterfactual Memory Attacks on LLM Agents
  4. 2026From Untrusted Input to Trusted Memory: A Systematic Study of Memory Poisoning Attacks in LLM Agents
  5. 2026Securing LLM-Agent Long-Term Memory Against Poisoning: Non-Malleable, Origin-Bound Authority with Machine-Checked Guarantees
  6. 2026Trojan Hippo: Weaponizing Agent Memory for Data Exfiltration
  7. 2026When Malicious Instructions Persist: Persistent Memory Poisoning Attack on Harness-Based Agents
  8. 2025A-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memory