Memory-Induced Tool-Drift in LLM Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Modern LLM agents combine long-term memory for personalization with tool-calling interfaces for taking actions in the world -- a combination underpinning contemporary production systems. We study a previously unexamined failure of this combination: when personality-driven biases stored in memory (cost-consciousness, impatience, risk tolerance, etc.) silently affect tool calls in contexts where they are not applicable. We call this memory-induced tool-drift and operationalize it through MEMDRIFT, a benchmark of 105 scenarios spanning five bias dimensions and seven professional domains, generated through an automated adversarial pipeline. Across seven frontier models -- including those with extended reasoning -- biased memories raise deflection scores (a judge-scored measure of parameter deviation from unbiased baselines) by up to +3.6 points on a 1--5 scale. Tool-drift persists when memory management is handled by three production memory architectures. The phenomenon affects real-world tools: scanning 6,062 tools across 288 verified MCP servers, we flag 608 with susceptible parameters and confirm tool-drift on a validated subset. Mechanistically, biased memories act as implicit steering vectors, pushing activations along the same latent directions as explicit behavioral instructions. They also redistribute attention from task-relevant context toward memory entries with surface-level keyword overlap to the target parameter. Standard defenses -- prompt-based relevance instructions and memory filters -- reduce drift but do not eliminate it. As agents take increasingly consequential actions on a user's behalf, memory-induced tool-drift represents a systematic vulnerability that current safeguards do not address, motivating dedicated defenses at the intersection of memory management and tool-call generation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 21 of its 43 references that are in the map. First posted on arXiv 24 May 2026.
Builds on
21 of 43 references.
Closest ancestors · 5
Same direction, newest first
- 2026OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agents20 Jan
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agents5 Jan
- 2025MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents20 Jun
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb
Other references · 16
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2023ToolAlpaca: Generalized Tool Learning for Language Models with 3000 Simulated Casescited by 383
- 2024Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuningcited by 87
- 2025ToolHop: A Query-Driven Benchmark for Evaluating Large Language Models in Multi-Hop Tool Usecited by 48
- 2025MemTool: Optimizing Short-Term Memory Management for Dynamic Tool Calling in LLM Agent Multi-Turn Conversationscited by 21
- 2025SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMscited by 21
4 more
- 2025Evaluating Personalized Tool-Augmented LLMs from the Perspectives of Personalization and Proactivitycited by 17
- 2026PersistBench: When Should Long-Term Memories Be Forgotten by LLMs?cited by 16
- 2026Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMscited by 13
- 2025Advancing and Benchmarking Personalized Tool Invocation for LLMscited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Beyond Similarity: Trustworthy Memory Search for Personal AI Agentscited by 6
- 2026Heterogeneous Agent Cohorts for Safe Open-Ended Exploration with Runtime Constraint Memorycited by 0
- 2026Testing and Evaluation of Agentic AI Systems In Military Command and Controlcited by 0
- 2026Epi-Logic: A Conceptual Framework for Epistemic Runtime Control, Schema Validity Checking, and Controlled Accommodation in Autonomous AI Agentscited by 0
- 2026Epi-Logic: A Conceptual Framework for Epistemic Runtime Control, Schema Validity Checking, and Controlled Accommodation in Autonomous AI Agents21 Sep 2026
- 2026Testing and Evaluation of Agentic AI Systems In Military Command and Control20 Aug 2026
- 2026Heterogeneous Agent Cohorts for Safe Open-Ended Exploration with Runtime Constraint Memory13 Jul 2026
- 2026Beyond Similarity: Trustworthy Memory Search for Personal AI Agents4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behavior
- 2026Looking Is Not Picking: An Attention-Segment Account of Tool-Selection Failures in LLM Agents
- 2026MemEvoBench: Benchmarking Safety Risks from Memory Misevolution in LLM Agents
- 2026MemMorph: Tool Hijacking in LLM Agents via Memory Poisoning
- 2026Set-shifting Behavioral Test for Harnessed Agents
- 2026MemSyco-Bench: Benchmarking Sycophancy in Agent Memory
- 2026From Storage to Steering: Memory Control Flow Attacks on LLM Agents
- 2026Toward User-Conditioned Evaluation of Personal LLM Agents under Temporal Interventions