mlsanityData to 7 Oct 2026

MemPot: Defending Against Memory Extraction Attack with Optimized Honeypots

arXiv 2602.07517 ↗First posted 7 Feb 2026cs.CR cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Large Language Model (LLM)-based agents employ external and internal memory systems to handle complex, goal-oriented tasks, yet this exposes them to severe extraction attacks, and effective defenses remain lacking. In this paper, we propose MemPot, the first theoretically verified defense framework against memory extraction attacks by injecting optimized honeypots into the memory. Through a two-stage optimization process, MemPot generates trap documents that maximize the retrieval probability for attackers while remaining inconspicuous to benign users. We model the detection process as Wald's Sequential Probability Ratio Test (SPRT) and theoretically prove that MemPot achieves a lower average number of sampling rounds compared to optimal static detectors. Empirically, MemPot significantly outperforms state-of-the-art baselines, achieving a 50% improvement in detection AUROC and an 80% increase in True Positive Rate under low False Positive Rate constraints. Furthermore, our experiments confirm that MemPot incurs zero additional online inference latency and preserves the agent's utility on standard tasks, verifying its superiority in safety, harmlessness, and efficiency.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 30 of its 42 references that are in the map. First posted on arXiv 7 Feb 2026.

Builds on

30 of 42 references.

References · 30

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2023A Survey of Large Language Modelscited by 2,537
  6. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  7. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  8. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  9. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  10. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  11. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
  12. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
18 more
  1. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 450
  2. 2025Memory in the Age of AI Agentscited by 285
  3. 2023A Language Agent for Autonomous Drivingcited by 161
  4. 2024The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG)cited by 159
  5. 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attackscited by 135
  6. 2025Unveiling Privacy Risks in LLM Agent Memorycited by 99
  7. 2023Conversational Health Agents: A Personalized LLM-Powered Agent Frameworkcited by 91
  8. 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
  9. 2024Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systemscited by 76
  10. 2024Intention Analysis Makes LLMs A Good Jailbreak Defendercited by 64
  11. 2024Large Language Model Agent in Financial Trading: A Surveycited by 60
  12. 2024Mitigating the Privacy Issues in Retrieval-Augmented Generation (RAG) via Pure Synthetic Datacited by 52
  13. 2024Is My Data in Your Retrieval Database? Membership Inference Attacks Against Retrieval Augmented Generationcited by 44
  14. 2024Unleashing Worms and Extracting Data: Escalating the Outcome of Attacks against RAG-based Inference in Scale and Severity Using Jailbreakingcited by 30
  15. 2024Reinforcement Learning for Optimizing RAG for Domain Chatbotscited by 26
  16. 2024Pirates of the RAG: Adaptively Attacking LLMs to Leak Knowledge Basescited by 17
  17. 2024Adversarial Decoding: Generating Readable Documents for Adversarial Objectivescited by 16
  18. 2025ControlNET: A Firewall for RAG-based LLM Systemcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.