ER-MIA: Black-Box Adversarial Memory Injection Attacks on Long-Term Memory-Augmented Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly augmented with long-term memory systems to overcome finite context windows and enable persistent reasoning across interactions. However, recent research finds that LLMs become more vulnerable because memory provides extra attack surfaces. In this paper, we present the first systematic study of black-box adversarial memory injection attacks that target the similarity-based retrieval mechanism in long-term memory-augmented LLMs. We introduce ER-MIA, a unified framework that exposes this vulnerability and formalizes two realistic attack settings: content-based attacks and question-targeted attacks. In these settings, ER-MIA includes an arsenal of composable attack primitives and ensemble attacks that achieve high success rates under minimal attacker assumptions. Extensive experiments across multiple LLMs and long-term memory systems demonstrate that similarity-based retrieval constitutes a fundamental and system-level vulnerability, revealing security risks that persist across memory designs and application scenarios.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 35 of its 39 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
35 of 39 references.
References · 35
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2025Gemma 3 Technical Reportcited by 1,686
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
23 more
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 663
- 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 488
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 402
- 2019Hidden Trigger Backdoor Attackscited by 359
- 2023Are aligned neural networks adversarially aligned?cited by 305
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Modelscited by 237
- 2023Poisoning Retrieval Corpora by Injecting Adversarial Passagescited by 153
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interactioncited by 127
- 2025Adaptive Attacks Break Defenses Against Indirect Prompt Injection Attacks on LLM Agentscited by 112
- 2020Adversarial Semantic Collisionscited by 42
- 2023Black-box Adversarial Attacks against Dense Retrieval Models: A Multi-view Contrastive Learning Methodcited by 29
- 2025Secure Retrieval-Augmented Generation against Poisoning Attackscited by 19
- 2026Overcoming the Retrieval Barrier: Indirect Prompt Injection in the Wild for LLM Systemscited by 16
- 2025Unsupervised Corpus Poisoning Attacks in Continuous Space for Dense Retrievalcited by 11
- 2025DeRAG: Black-box Adversarial Attacks on Multiple Retrieval-Augmented Generation Applications via Prompt Injectioncited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026ShadowMerge: A Novel Poisoning Attack on Graph-Based Agent Memory via Relation-Channel Conflictscited by 0
- 2026MAFIA: Query-Only Memory Attacks via Probing and Factual Injection against Audited LLM Agentscited by 0
- 2026Understanding Stage-Wise Utility-Risk Trade-offs in LLM Agent Memorycited by 0
- 2026Transferable End-to-End Optimization for Indirect Long-Term Memory Poisoning in LLM Agentscited by 0
- 2026Transferable End-to-End Optimization for Indirect Long-Term Memory Poisoning in LLM Agents1 Sep 2026
- 2026Understanding Stage-Wise Utility-Risk Trade-offs in LLM Agent Memory31 Aug 2026
- 2026MAFIA: Query-Only Memory Attacks via Probing and Factual Injection against Audited LLM Agents4 Aug 2026
- 2026ShadowMerge: A Novel Poisoning Attack on Graph-Based Agent Memory via Relation-Channel Conflicts9 May 2026