Do Agents Dream of False Memories? Black-box Visual Attacks on Long-term Memory in Multimodal AI Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
Multimodal AI agents increasingly rely on persistent long-term memory to ground generation in past visual and textual episodes. We show that unconditional trust in visual data creates a critical vulnerability. We propose Lucid, a black-box adversarial framework that compromises multimodal memory pipelines under a strictly image-bounded threat model, requiring no access to the target MLLM, target retrieval encoder, or the text channel. Lucid crafts imperceptible perturbations to enable two distinct failure modes based on the availability of historical context: (1) Memory poisoning, an in-context attack where the adversarial image replaces a benign one whose content is reinforced by prior textual context, reliably corrupting visual recall and steering the agent toward attacker-chosen narratives; (2) Memory injection, an out-of-context attack where the adversarial image replaces a benign one in a conversation turn devoid of prior textual grounding, causing the agent to generate attacker-influenced responses with no corrective signal from memory. We evaluate Lucid across various conversation domains and five black-box memory architectures, including graph-structured, LLM-summarized, and commercially deployed systems. Lucid achieves 61.6% ASR on poisoning and 58.4% ASR on injection, exposing a structural vulnerability in multimodal memory pipelines.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 76 of its 89 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
76 of 89 references.
Closest ancestors · 5
Same direction, newest first
- 2026Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoning18 Apr
- 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun
- 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast13 Feb
Other references · 71
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
38 more
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 281
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
- 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 220
- 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 216
- 2023LooGLE: Can Long-Context Language Models Understand Long Contexts?cited by 200
- 2023How Robust is Google's Bard to Adversarial Image Attacks?cited by 177
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 166
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 160
- 2023Poisoning Retrieval Corpora by Injecting Adversarial Passagescited by 153
- 2024How to Train Long-Context Language Models (Effectively)cited by 141
- 2025Memory OS of AI Agentcited by 140
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
- 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
- 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 119
- 2023Abusing Images and Sounds for Indirect Instruction Injection in Multi-Modal LLMscited by 117
- 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approachcited by 117
- 2023AssistGPT: A General Multi-modal Assistant that can Plan, Execute, Inspect, and Learncited by 97
- 2023Conversational Health Agents: A Personalized LLM-Powered Agent Frameworkcited by 91
- 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
- 2023Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Modelscited by 87
- 2025MemInsight: Autonomous Memory Augmentation for LLM Agentscited by 84
- 2020Adv-watermark: A Novel Watermark Perturbation for Adversarial Examplescited by 56
- 2023See and Think: Embodied Agent in Virtual Environmentcited by 54
- 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoningcited by 50
- 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agentscited by 49
- 2024AnyAttack: Towards Large-scale Self-supervised Adversarial Attacks on Vision-language Modelscited by 43
- 2025Adversarial Attacks against Closed-Source MLLMs via Feature Optimal Alignmentcited by 42
- 2017Google's Cloud Vision API Is Not Robust To Noisecited by 37
- 2024Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Modelscited by 36
- 2025A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o1cited by 34
50 most cited of 71 All 71 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Visual Memory Attacks Can Persist Through The KV Cachecited by 0
- 2026Visual Memory Attacks Can Persist Through The KV Cache6 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2026Hidden in Memory: Sleeper Memory Poisoning in LLM Agents
- 2026From Untrusted Input to Trusted Memory: A Systematic Study of Memory Poisoning Attacks in LLM Agents
- 2026MemVenom: Triggered Poisoning of Multimodal Memories in Web Agents
- 2026Bad Memory: Evaluating Prompt Injection Risks from Memory in Agentic Systems
- 2026When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agents
- 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory
- 2026MemEvoBench: Benchmarking Safety Risks from Memory Misevolution in LLM Agents
- 2025MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrieval