A-MemGuard: A Proactive Defense Framework for LLM-Based Agent Memory
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Large Language Model (LLM) agents use memory to learn from past interactions, enabling autonomous planning and decision-making in complex environments. However, this reliance on memory introduces a critical security risk: an adversary can inject seemingly harmless records into an agent's memory to manipulate its future behavior. This vulnerability is characterized by two core aspects: First, the malicious effect of injected records is only activated within a specific context, making them hard to detect when individual memory entries are audited in isolation. Second, once triggered, the manipulation can initiate a self-reinforcing error cycle: the corrupted outcome is stored as precedent, which not only amplifies the initial error but also progressively lowers the threshold for similar attacks in the future. To address these challenges, we introduce A-MemGuard (Agent-Memory Guard), the first proactive defense framework for LLM agent memory. The core idea of our work is the insight that memory itself must become both self-checking and self-correcting. Without modifying the agent's core architecture, A-MemGuard combines two mechanisms: (1) consensus-based validation, which detects anomalies by comparing reasoning paths derived from multiple related memories and (2) a dual-memory structure, where detected failures are distilled into ``lessons'' stored separately and consulted before future actions, breaking error cycles and enabling adaptation. Comprehensive evaluations on multiple benchmarks show that A-MemGuard effectively cuts attack success rates by over 95% while incurring a minimal utility cost. This work shifts LLM memory security from static filtering to a proactive, experience-driven model where defenses strengthen over time. Our code is available in https://github.com/TangciuYueng/AMemGuard
Key facts. Cited by 61 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 36 of its 40 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
36 of 40 references.
Closest ancestors · 5
Same direction, newest first
- 2025AgentAuditor: Human-Level Safety and Security Evaluation for LLM Agents31 May
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
- 2025Unveiling Privacy Risks in LLM Agent Memory17 Feb
- 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
Other references · 31
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2024GPT-4o System Cardcited by 4,467
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
19 more
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
- 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 459
- 2023Detecting Language Model Attacks with Perplexitycited by 411
- 2023An Embodied Generalist Agent in 3D Worldcited by 355
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 319
- 2023Certifying LLM Safety against Adversarial Promptingcited by 248
- 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 226
- 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Recordscited by 75
- 2024BadChain: Backdoor Chain-of-Thought Prompting for Large Language Modelscited by 74
- 2022Machine Learning Security against Data Poisoning: Are We There Yet?cited by 23
- 2025Data Poisoning in Deep Learning: A Surveycited by 20
- 2025Goal-Aware Identification and Rectification of Misinformation in Multi-Agent Systemscited by 7
- 2024The Best Defense is a Good Offense: Countering LLM-Powered Cyberattackscited by 2
Built on by
Citing papers per year: 2025: 5; 2026: 56.
61 papers.
Sort:
By area:
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 64
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
- 2026Memory Poisoning Attack and Defense on Memory Based LLM-Agentscited by 40
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 40
- 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agentscited by 29
- 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threatscited by 25
- 2026A Survey on Long-Term Memory Security in LLM Agents: Attacks, Defenses, and Governance Across the Memory Lifecyclecited by 21
- 2026From Storage to Steering: Memory Control Flow Attacks on LLM Agentscited by 17
- 2025A Vision for Access Control in LLM-based Agent Systemscited by 14
- 2026SafeHarness: Lifecycle-Integrated Security Architecture for LLM-based Agent Deploymentcited by 14
- 2026MemLineage: Lineage-Guided Enforcement for LLM Agent Memorycited by 14
- 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
38 more
- 2026Trojan Hippo: Weaponizing Agent Memory for Data Exfiltrationcited by 12
- 2026MemMark: State-Evolution Attribution Watermarking for Agent Long-Term Memory Systemscited by 12
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactionscited by 11
- 2026OEP: Poisoning Self-Evolving LLM Agents via Locally Correct but Non-Transferable Experiencescited by 9
- 2026SOK: A Taxonomy of Attack Vectors and Defense Strategies for Agentic Supply Chain Runtimecited by 8
- 2026TAME: A Trustworthy Test-Time Evolution of Agent Memory with Systematic Benchmarkingcited by 7
- 2026No Attacker Needed: Unintentional Cross-User Contamination in Shared-State LLM Agentscited by 6
- 2026MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detectioncited by 6
- 2026When Does Belief-Based Agent Memory Help? Reliability-Conditional Updating and Provenance-Capped Poisoning Defensecited by 6
- 2026When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundarycited by 6
- 2025PEAR: Planner-Executor Agent Robustness Benchmarkcited by 5
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluationcited by 5
- 2026Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoningcited by 4
- 2026Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agentscited by 4
- 2026SMSR: Certified Defence Against Runtime Memory Poisoning in Persistent LLM Agent Systemscited by 4
- 2026Your Agent's Memories Are Not Its Own: Forged Reasoning Attacks on LLM Agent Memory and Defensescited by 4
- 2026MEMSAD: Gradient-Coupled Anomaly Detection for Memory Poisoning in Retrieval-Augmented Agentscited by 3
- 2026EquiMem: Calibrating Shared Memory in Multi-Agent Debate via Game-Theoretic Equilibriumcited by 3
- 2026The Trap of Trajectory: Towards Understanding and Mitigating Spurious Correlations in Agentic Memorycited by 3
- 2026When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agentscited by 3
- 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agentscited by 3
- 2026Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memorycited by 3
- 2026Memory Reward Inflation in Self-Improving LLM Agentscited by 3
- 2026AgenticCyOps: Securing Multi-Agentic AI Integration in Enterprise Cyber Operationscited by 2
- 2026When Convenience Becomes Risk: A Semantic View of Under-Specification in Host-Acting Agentscited by 1
- 2026AgentWard: A Lifecycle Security Architecture for Autonomous AI Agentscited by 1
- 2026Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasurescited by 1
- 2026The Self-Correction Illusion: Role Relabeling Gates Explicit Error Flagging in Large Language Modelscited by 1
- 2026DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operationscited by 1
- 2026S3: Improving Agent Safety through Multi-Stage Defensecited by 1
- 2026When Context Bites: Detecting RAG Poisoning via Document-Level Attention Collapsecited by 1
- 2026Proof-of-Execution Memory: Defending LLM Agents Against Forged-Reasoning Attacks by Verifying What Actually Happenedcited by 1
- 2026"Are You Sure?": An Empirical Study of Human Perception Vulnerability in LLM-Driven Agentic Systemscited by 0
- 2026Ghost in the Context: Policy-Carriage Integrity in LLM Agentscited by 0
- 2026The Misattribution Gap: When Memory Poisoning Looks Like Model Failure in Agentic AI Systemscited by 0
- 2026RT-SHCUA: Real-Time Self-Hosted Computer-Use Agent for UAV Controlcited by 0
- 2026MIND: Lightweight and Effective Memory Injection Defense for LLM Agents via Intent-Aware Information Bottleneckcited by 0
- 2026MAPLE-Guard: Memory-Aware Link Enforcement Against Memory-Link Poisoning in Multi-Agent Systemscited by 0
50 most cited of 61 All 61 (JSON)
- 2026When Correct Memory Goes Wrong: Fuzzing Persistent Memory Use in LLM Agents29 Sep 2026
- 2026VirusCascade: Hijacking Collaborative Reflection in LLM-Powered Recommender Agents29 Sep 2026
- 2026SafeCoEvo: Co-Evolving Safety Harnesses and Guards for LLM Agents at Test-Time29 Sep 2026
- 2026A Benchmark and Diagnostic Study of Epistemic Admission in Shared Agent Memory25 Sep 2026
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026The Price of Safety: Benign-Case Utility and Token Overhead of Memory-Poisoning Defenses in LLM Agents19 Sep 2026
- 2026Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectives15 Sep 2026
- 2026MemSentry: A Framework for Detecting Persistent Memory Poisoning in Agentic AI8 Sep 2026
- 2026Transferable End-to-End Optimization for Indirect Long-Term Memory Poisoning in LLM Agents1 Sep 2026
- 2026Proof-of-Execution Memory: Defending LLM Agents Against Forged-Reasoning Attacks by Verifying What Actually Happened17 Aug 2026
- 2026When Context Bites: Detecting RAG Poisoning via Document-Level Attention Collapse7 Aug 2026
- 2026MAFIA: Query-Only Memory Attacks via Probing and Factual Injection against Audited LLM Agents4 Aug 2026
38 more
- 2026S3: Improving Agent Safety through Multi-Stage Defense3 Aug 2026
- 2026When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundary3 Aug 2026
- 2026Salami Attack: Stealthy Collusive Memory Poisoning against OpenClaw3 Aug 2026
- 2026MAPLE-Guard: Memory-Aware Link Enforcement Against Memory-Link Poisoning in Multi-Agent Systems1 Aug 2026
- 2026Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memory31 Jul 2026
- 2026MIND: Lightweight and Effective Memory Injection Defense for LLM Agents via Intent-Aware Information Bottleneck30 Jul 2026
- 2026DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operations22 Jul 2026
- 2026RT-SHCUA: Real-Time Self-Hosted Computer-Use Agent for UAV Control20 Jul 2026
- 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agents16 Jul 2026
- 2026When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agents6 Jul 2026
- 2026Your Agent's Memories Are Not Its Own: Forged Reasoning Attacks on LLM Agent Memory and Defenses6 Jul 2026
- 2026Memory Reward Inflation in Self-Improving LLM Agents29 Jun 2026
- 2026When Does Belief-Based Agent Memory Help? Reliability-Conditional Updating and Provenance-Capped Poisoning Defense20 Jun 2026
- 2026SMSR: Certified Defence Against Runtime Memory Poisoning in Persistent LLM Agent Systems10 Jun 2026
- 2026Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation9 Jun 2026
- 2026The Self-Correction Illusion: Role Relabeling Gates Explicit Error Flagging in Large Language Models4 Jun 2026
- 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agents3 Jun 2026
- 2026Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasures25 May 2026
- 2026MemMark: State-Evolution Attribution Watermarking for Agent Long-Term Memory Systems24 May 2026
- 2026MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detection22 May 2026
- 2026OEP: Poisoning Self-Evolving LLM Agents via Locally Correct but Non-Transferable Experiences18 May 2026
- 2026Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agents18 May 2026
- 2026MemLineage: Lineage-Guided Enforcement for LLM Agent Memory14 May 2026
- 2026The Misattribution Gap: When Memory Poisoning Looks Like Model Failure in Agentic AI Systems12 May 2026
- 2026The Trap of Trajectory: Towards Understanding and Mitigating Spurious Correlations in Agentic Memory10 May 2026
- 2026EquiMem: Calibrating Shared Memory in Multi-Agent Debate via Game-Theoretic Equilibrium10 May 2026
- 2026MEMSAD: Gradient-Coupled Anomaly Detection for Memory Poisoning in Retrieval-Augmented Agents5 May 2026
- 2026Trojan Hippo: Weaponizing Agent Memory for Data Exfiltration3 May 2026
- 2026Ghost in the Context: Policy-Carriage Integrity in LLM Agents2 May 2026
- 2026AgentWard: A Lifecycle Security Architecture for Autonomous AI Agents27 Apr 2026
- 2026Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoning18 Apr 2026
- 2026A Survey on Long-Term Memory Security in LLM Agents: Attacks, Defenses, and Governance Across the Memory Lifecycle17 Apr 2026
- 2026SafeHarness: Lifecycle-Integrated Security Architecture for LLM-based Agent Deployment15 Apr 2026
- 2026No Attacker Needed: Unintentional Cross-User Contamination in Shared-State LLM Agents1 Apr 2026
- 2026When Convenience Becomes Risk: A Semantic View of Under-Specification in Host-Acting Agents22 Mar 2026
- 2026From Storage to Steering: Memory Control Flow Attacks on LLM Agents16 Mar 2026
- 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threats12 Mar 2026
- 2026AgenticCyOps: Securing Multi-Agentic AI Integration in Enterprise Cyber Operations10 Mar 2026
50 newest of 61 All 61 (JSON)
- 2026ToolSafe: Enhancing Tool Invocation Safety of LLM-based agents via Proactive Step-level Guardrail and Feedbackcited by 64
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
- 2026Memory Poisoning Attack and Defense on Memory Based LLM-Agentscited by 40
- 2026A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agentscited by 40
- 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agentscited by 29
- 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threatscited by 25
- 2026A Survey on Long-Term Memory Security in LLM Agents: Attacks, Defenses, and Governance Across the Memory Lifecyclecited by 21
- 2026From Storage to Steering: Memory Control Flow Attacks on LLM Agentscited by 17
- 2025A Vision for Access Control in LLM-based Agent Systemscited by 14
- 2026SafeHarness: Lifecycle-Integrated Security Architecture for LLM-based Agent Deploymentcited by 14
- 2026MemLineage: Lineage-Guided Enforcement for LLM Agent Memorycited by 14
- 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
12 most cited of 53 All 53 (JSON)
- 2026When Correct Memory Goes Wrong: Fuzzing Persistent Memory Use in LLM Agents29 Sep 2026
- 2026VirusCascade: Hijacking Collaborative Reflection in LLM-Powered Recommender Agents29 Sep 2026
- 2026SafeCoEvo: Co-Evolving Safety Harnesses and Guards for LLM Agents at Test-Time29 Sep 2026
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026The Price of Safety: Benign-Case Utility and Token Overhead of Memory-Poisoning Defenses in LLM Agents19 Sep 2026
- 2026Toward Secure AI-Powered Penetration Testing Agents: Security Threats, Guardrails, and Architectural Perspectives15 Sep 2026
- 2026MemSentry: A Framework for Detecting Persistent Memory Poisoning in Agentic AI8 Sep 2026
- 2026Transferable End-to-End Optimization for Indirect Long-Term Memory Poisoning in LLM Agents1 Sep 2026
- 2026Proof-of-Execution Memory: Defending LLM Agents Against Forged-Reasoning Attacks by Verifying What Actually Happened17 Aug 2026
- 2026MAFIA: Query-Only Memory Attacks via Probing and Factual Injection against Audited LLM Agents4 Aug 2026
- 2026S3: Improving Agent Safety through Multi-Stage Defense3 Aug 2026
- 2026When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundary3 Aug 2026
12 newest of 53 All 53 (JSON)
- 2026SMSR: Certified Defence Against Runtime Memory Poisoning in Persistent LLM Agent Systemscited by 4
- 2026MEMSAD: Gradient-Coupled Anomaly Detection for Memory Poisoning in Retrieval-Augmented Agentscited by 3
- 2026When Context Bites: Detecting RAG Poisoning via Document-Level Attention Collapsecited by 1
- 2026When Context Bites: Detecting RAG Poisoning via Document-Level Attention Collapse7 Aug 2026
- 2026SMSR: Certified Defence Against Runtime Memory Poisoning in Persistent LLM Agent Systems10 Jun 2026
- 2026MEMSAD: Gradient-Coupled Anomaly Detection for Memory Poisoning in Retrieval-Augmented Agents5 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026MemEvoBench: Benchmarking Safety Risks from Memory Misevolution in LLM Agents
- 2026From Attack Success to Attack Severity: Counterfactual Memory Attacks on LLM Agents
- 2026MemGym: a Long-Horizon Memory Environment for LLM Agents
- 2026MemSecBench: Tracking Agent Memory Poisoning from Persistence to Consequence and Repair
- 2026From Untrusted Input to Trusted Memory: A Systematic Study of Memory Poisoning Attacks in LLM Agents
- 2025MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrieval
- 2026Securing LLM-Agent Long-Term Memory Against Poisoning: Non-Malleable, Origin-Bound Authority with Machine-Checked Guarantees
- 2026AgentSys: Secure and Dynamic LLM Agents Through Explicit Hierarchical Memory Management