State Contamination in Memory-Augmented LLM Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
LLM agents increasingly rely on persistent state, including transcripts, summaries, retrieved context, and memory buffers, to support long-horizon interaction. This makes safety depend not only on individual model outputs, but also on what an agent stores and later reuses. We study a failure mode we call memory laundering: toxic or adversarial context can be compressed into memory summaries that no longer appear toxic under standard detectors, while still preserving hostile framing or conflict structure that influences future generations. Using paired counterfactual multi-agent rollouts, we show that toxic-origin memory summaries can remain below common toxicity thresholds while nevertheless increasing downstream toxicity relative to matched neutral baselines. To measure this hidden influence, we introduce the sub-threshold propagation gap (SPG), which quantifies downstream behavioral differences conditioned on memory states that a deployed monitor would classify as safe. Our experiments show that toxicity propagates through distinct state channels: raw transcript reuse drives overt downstream toxicity, while compressed memory carries hidden sub-threshold influence. We further find that mitigation depends critically on intervention placement. Sanitizing toxic state before summarization substantially reduces the hidden propagation gap, whereas cleaning only the completed summary can leave laundered influence intact. These results suggest that safety in memory-augmented agents should be treated as a state-control problem over evolving context, with sanitization applied before unsafe information is compressed into persistent memory.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 33 of its 41 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
33 of 41 references.
Closest ancestors · 5
Same direction, newest first
- 2026Position: Safety and Fairness in Agentic AI Depend on Interaction Topology, Not on Model Scale or Alignment1 May
- 2026AgentWorm: Self-Propagating Attacks Across LLM Agent Ecosystems16 Mar
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis27 Feb
- 2025Unveiling Privacy Risks in LLM Agent Memory17 Feb
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
Other references · 28
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 437
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2023Large Language Model Unlearningcited by 302
16 more
- 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
- 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 72
- 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontierscited by 65
- 2023Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Modelscited by 62
- 2025Collaborative Memory: Multi-User Memory Sharing in LLM Agents with Dynamic Access Controlcited by 61
- 2025MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systemscited by 61
- 2024Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applicationscited by 59
- 2024Large Language Model Safety: A Holistic Surveycited by 59
- 2024AI Safety in Generative AI Large Language Models: A Surveycited by 33
- 2024INMS: Memory Sharing for Large Language Model based Agentscited by 31
- 2024Reinforcement Learning for Optimizing RAG for Domain Chatbotscited by 26
- 2026Active Context Compression: Autonomous Memory Management in LLM Agentscited by 16
- 2025Breaking Bad Tokens: Detoxification of LLMs Using Sparse Autoencoderscited by 9
- 2026AI Agents Need Memory Control Over More Contextcited by 7
- 2025Incremental Summarization for Customer Support via Progressive Note-Taking and Agent Feedbackcited by 4
- 2026CausalDetox: Causal Head Selection and Intervention for Language Model Detoxificationcited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Facts Without Rules: Boundary Metadata Collapse in Multi-Agent LLM Handoffscited by 0
- 2026CoMem: Collective-Individual Memory Synergy for Evolutionary Multi-Agent Systemscited by 0
- 2026Self-Cleaning and Captured Anyway: One Measured Primitive for Error in a Store an Agent Writes to Itself, and What a Falling Score Actually Measurescited by 0
- 2026How Strongly Should Task State Influence an LLM Agent?cited by 0
- 2026What to Admit and How to Present: Governing Persistent Memory in LLM Agentscited by 0
- 2026What to Admit and How to Present: Governing Persistent Memory in LLM Agents8 Oct 2026
- 2026How Strongly Should Task State Influence an LLM Agent?22 Sep 2026
- 2026CoMem: Collective-Individual Memory Synergy for Evolutionary Multi-Agent Systems14 Sep 2026
- 2026Self-Cleaning and Captured Anyway: One Measured Primitive for Error in a Store an Agent Writes to Itself, and What a Falling Score Actually Measures6 Sep 2026
- 2026Facts Without Rules: Boundary Metadata Collapse in Multi-Agent LLM Handoffs29 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agents
- 2026MemForm: Benchmarking Memory Formation Poisoning in LLM Agents
- 2026From Untrusted Input to Trusted Memory: A Systematic Study of Memory Poisoning Attacks in LLM Agents
- 2026Understanding Stage-Wise Utility-Risk Trade-offs in LLM Agent Memory
- 2026MemEvoBench: Benchmarking Safety Risks from Memory Misevolution in LLM Agents
- 2026Hidden in Memory: Sleeper Memory Poisoning in LLM Agents
- 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agents
- 2026Securing LLM-Agent Long-Term Memory Against Poisoning: Non-Malleable, Origin-Bound Authority with Machine-Checked Guarantees