mlsanityData to 7 Oct 2026

A-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memory

arXiv 2510.02373 ↗First posted 29 Sep 2025cs.CR cs.AIcited by 61

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Large Language Model (LLM) agents use memory to learn from past interactions, enabling autonomous planning and decision-making in complex environments. However, this reliance on memory introduces a critical security risk: an adversary can inject seemingly harmless records into an agent's memory to manipulate its future behavior. This vulnerability is characterized by two core aspects: First, the malicious effect of injected records is only activated within a specific context, making them hard to detect when individual memory entries are audited in isolation. Second, once triggered, the manipulation can initiate a self-reinforcing error cycle: the corrupted outcome is stored as precedent, which not only amplifies the initial error but also progressively lowers the threshold for similar attacks in the future. To address these challenges, we introduce A-MemGuard (Agent-Memory Guard), the first proactive defense framework for LLM agent memory. The core idea of our work is the insight that memory itself must become both self-checking and self-correcting. Without modifying the agent's core architecture, A-MemGuard combines two mechanisms: (1) consensus-based validation, which detects anomalies by comparing reasoning paths derived from multiple related memories and (2) a dual-memory structure, where detected failures are distilled into ``lessons'' stored separately and consulted before future actions, breaking error cycles and enabling adaptation. Comprehensive evaluations on multiple benchmarks show that A-MemGuard effectively cuts attack success rates by over 95% while incurring a minimal utility cost. This work shifts LLM memory security from static filtering to a proactive, experience-driven model where defenses strengthen over time. Our code is available in https://github.com/TangciuYueng/AMemGuard

Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 36 of its 40 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

36 of 40 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
  2. 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
  3. 2025Unveiling Privacy Risks in LLM Agent Memory17 Feb
  4. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  5. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul

Other references · 31

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  7. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  8. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  9. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  10. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  11. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  12. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
19 more
  1. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  2. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  3. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  4. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  5. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
  6. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  7. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  8. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 459
  9. 2023Detecting Language Model Attacks with Perplexitycited by 411
  10. 2023An Embodied Generalist Agent in 3D Worldcited by 355
  11. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 319
  12. 2023Certifying LLM Safety against Adversarial Promptingcited by 248
  13. 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 226
  14. 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 75
  15. 2024BadChain: Backdoor Chain-of-Thought Prompting for Large Language Modelscited by 74
  16. 2022Machine Learning Security against Data Poisoning: Are We There Yet?cited by 23
  17. 2025Data Poisoning in Deep Learning: A Surveycited by 20
  18. 2025Goal-Aware Identification and Rectification of Misinformation in Multi-Agent Systemscited by 7
  19. 2024The Best Defense is a Good Offense: Countering LLM-Powered Cyberattackscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 56.

61 papers.

Sort:

By area:

  1. 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 64
  2. 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
  3. 2026Memory Poisoning Attack and Defense on Memory Based LLM-Agentscited by 40
  4. 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 40
  5. 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agentscited by 29
  6. 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threatscited by 25
  7. 2026A Survey on Long-Term Memory Security in LLM Agents: Attacks, Defenses, and Governance Across the Memory Lifecyclecited by 21
  8. 2026From Storage to Steering: Memory Control Flow Attacks on LLM Agentscited by 17
  9. 2025A Vision for Access Control in LLM-based Agent Systemscited by 14
  10. 2026SafeHarness: Lifecycle-Integrated Security Architecture for LLM-based Agent Deploymentcited by 14
  11. 2026MemLineage: Lineage-Guided Enforcement for LLM Agent Memorycited by 14
  12. 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
38 more
  1. 2026Trojan Hippo: Weaponizing Agent Memory for Data Exfiltrationcited by 12
  2. 2026MemMark: State-Evolution Attribution Watermarking for Agent Long-Term Memory Systemscited by 12
  3. 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactionscited by 11
  4. 2026OEP: Poisoning Self-Evolving LLM Agents via Locally Correct but Non-Transferable Experiencescited by 9
  5. 2026SOK: A Taxonomy of Attack Vectors and Defense Strategies for Agentic Supply Chain Runtimecited by 8
  6. 2026TAME: A Trustworthy Test-Time Evolution of Agent Memory with Systematic Benchmarkingcited by 7
  7. 2026No Attacker Needed: Unintentional Cross-User Contamination in Shared-State LLM Agentscited by 6
  8. 2026MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detectioncited by 6
  9. 2026When Does Belief-Based Agent Memory Help? Reliability-Conditional Updating and Provenance-Capped Poisoning Defensecited by 6
  10. 2026When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundarycited by 6
  11. 2025PEAR: Planner-Executor Agent Robustness Benchmarkcited by 5
  12. 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 5
  13. 2026Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoningcited by 4
  14. 2026Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agentscited by 4
  15. 2026SMSR: Certified Defence Against Runtime Memory Poisoning in Persistent LLM Agent Systemscited by 4
  16. 2026Your Agent's Memories Are Not Its Own: Forged Reasoning Attacks on LLM Agent Memory and Defensescited by 4
  17. 2026MEMSAD: Gradient-Coupled Anomaly Detection for Memory Poisoning in Retrieval-Augmented Agentscited by 3
  18. 2026EquiMem: Calibrating Shared Memory in Multi-Agent Debate via Game-Theoretic Equilibriumcited by 3
  19. 2026The Trap of Trajectory: Towards Understanding and Mitigating Spurious Correlations in Agentic Memorycited by 3
  20. 2026When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agentscited by 3
  21. 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agentscited by 3
  22. 2026Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memorycited by 3
  23. 2026Memory Reward Inflation in Self-Improving LLM Agentscited by 3
  24. 2026AgenticCyOps: Securing Multi-Agentic AI Integration in Enterprise Cyber Operationscited by 2
  25. 2026When Convenience Becomes Risk: A Semantic View of Under-Specification in Host-Acting Agentscited by 1
  26. 2026AgentWard: A Lifecycle Security Architecture for Autonomous AI Agentscited by 1
  27. 2026Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasurescited by 1
  28. 2026The Self-Correction Illusion: Role Relabeling Gates Explicit Error Flagging in Large Language Modelscited by 1
  29. 2026DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operationscited by 1
  30. 2026S3: Improving Agent Safety through Multi-Stage Defensecited by 1
  31. 2026When Context Bites: Detecting RAG Poisoning via Document-Level Attention Collapsecited by 1
  32. 2026Proof-of-Execution Memory: Defending LLM Agents Against Forged-Reasoning Attacks by Verifying What Actually Happenedcited by 1
  33. 2026"Are You Sure?": An Empirical Study of Human Perception Vulnerability in LLM-Driven Agentic Systemscited by 0
  34. 2026Ghost in the Context: Policy-Carriage Integrity in LLM Agentscited by 0
  35. 2026The Misattribution Gap: When Memory Poisoning Looks Like Model Failure in Agentic AI Systemscited by 0
  36. 2026RT-SHCUA: Real-Time Self-Hosted Computer-Use Agent for UAV Controlcited by 0
  37. 2026MIND: Lightweight and Effective Memory Injection Defense for LLM Agents via Intent-Aware Information Bottleneckcited by 0
  38. 2026MAPLE-Guard: Memory-Aware Link Enforcement Against Memory-Link Poisoning in Multi-Agent Systemscited by 0

50 most cited of 61 All 61 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026MemEvoBench: Benchmarking Safety Risks from Memory Misevolution in LLM Agents
  2. 2026From Attack Success to Attack Severity: Counterfactual Memory Attacks on LLM Agents
  3. 2026MemGym: a Long-Horizon Memory Environment for LLM Agents
  4. 2026MemSecBench: Tracking Agent Memory Poisoning from Persistence to Consequence and Repair
  5. 2026From Untrusted Input to Trusted Memory: A Systematic Study of Memory Poisoning Attacks in LLM Agents
  6. 2025MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrieval
  7. 2026Securing LLM-Agent Long-Term Memory Against Poisoning: Non-Malleable, Origin-Bound Authority with Machine-Checked Guarantees
  8. 2026AgentSys: Secure and Dynamic LLM Agents Through Explicit Hierarchical Memory Management