mlsanityData to 7 Oct 2026

Do Agents Dream of False Memories? Black-box Visual Attacks on Long-term Memory in Multimodal AI Agents

arXiv 2607.15657 ↗First posted 17 Jul 2026cs.CR cs.CV cs.LGcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Multimodal AI agents increasingly rely on persistent long-term memory to ground generation in past visual and textual episodes. We show that unconditional trust in visual data creates a critical vulnerability. We propose Lucid, a black-box adversarial framework that compromises multimodal memory pipelines under a strictly image-bounded threat model, requiring no access to the target MLLM, target retrieval encoder, or the text channel. Lucid crafts imperceptible perturbations to enable two distinct failure modes based on the availability of historical context: (1) Memory poisoning, an in-context attack where the adversarial image replaces a benign one whose content is reinforced by prior textual context, reliably corrupting visual recall and steering the agent toward attacker-chosen narratives; (2) Memory injection, an out-of-context attack where the adversarial image replaces a benign one in a conversation turn devoid of prior textual grounding, causing the agent to generate attacker-influenced responses with no corrective signal from memory. We evaluate Lucid across various conversation domains and five black-box memory architectures, including graph-structured, LLM-summarized, and commercially deployed systems. Lucid achieves 61.6% ASR on poisoning and 58.4% ASR on injection, exposing a structural vulnerability in multimodal memory pipelines.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 76 of its 89 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

76 of 89 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Visual Inception: Compromising Long-term Planning in Agentic Recommenders via Multimodal Memory Poisoning18 Apr
  2. 2025Memory Injection Attacks on LLM Agents via Query-Only Interaction5 Mar
  3. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul
  4. 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agents5 Jun
  5. 2024Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast13 Feb

Other references · 71

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  6. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  8. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  9. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  10. 2022Emergent Abilities of Large Language Modelscited by 2,483
  11. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  12. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
38 more
  1. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  2. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  3. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
  4. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  5. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  6. 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 281
  7. 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
  8. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
  9. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
  10. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
  11. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 220
  12. 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 216
  13. 2023LooGLE: Can Long-Context Language Models Understand Long Contexts?cited by 200
  14. 2023How Robust is Google's Bard to Adversarial Image Attacks?cited by 177
  15. 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 166
  16. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 160
  17. 2023Poisoning Retrieval Corpora by Injecting Adversarial Passagescited by 153
  18. 2024How to Train Long-Context Language Models (Effectively)cited by 141
  19. 2025Memory OS of AI Agentcited by 140
  20. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  21. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
  22. 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 119
  23. 2023Abusing Images and Sounds for Indirect Instruction Injection in Multi-Modal LLMscited by 117
  24. 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approachcited by 117
  25. 2023AssistGPT: A General Multi-modal Assistant that can Plan, Execute, Inspect, and Learncited by 97
  26. 2023Conversational Health Agents: A Personalized LLM-Powered Agent Frameworkcited by 91
  27. 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
  28. 2023Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Modelscited by 87
  29. 2025MemInsight: Autonomous Memory Augmentation for LLM Agentscited by 84
  30. 2020Adv-watermark: A Novel Watermark Perturbation for Adversarial Examplescited by 56
  31. 2023See and Think: Embodied Agent in Virtual Environmentcited by 54
  32. 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoningcited by 50
  33. 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agentscited by 49
  34. 2024AnyAttack: Towards Large-scale Self-supervised Adversarial Attacks on Vision-language Modelscited by 43
  35. 2025Adversarial Attacks against Closed-Source MLLMs via Feature Optimal Alignmentcited by 42
  36. 2017Google's Cloud Vision API Is Not Robust To Noisecited by 37
  37. 2024Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Modelscited by 36
  38. 2025A Frustratingly Simple Yet Highly Effective Attack Baseline: Over 90% Success Rate Against the Strong Black-box Models of GPT-4.5/4o/o1cited by 34

50 most cited of 71 All 71 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Hidden in Memory: Sleeper Memory Poisoning in LLM Agents
  2. 2026From Untrusted Input to Trusted Memory: A Systematic Study of Memory Poisoning Attacks in LLM Agents
  3. 2026MemVenom: Triggered Poisoning of Multimodal Memories in Web Agents
  4. 2026Bad Memory: Evaluating Prompt Injection Risks from Memory in Agentic Systems
  5. 2026When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agents
  6. 2026MemEye: A Visual-Centric Evaluation Framework for Multimodal Agent Memory
  7. 2026MemEvoBench: Benchmarking Safety Risks from Memory Misevolution in LLM Agents
  8. 2025MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrieval