mlsanityData to 14 Oct 2026

When Routine Chats Turn Toxic: Unintended Long-Term State Poisoning in Personalized Agents

arXiv 2605.06731 ↗First posted 7 May 2026cs.CR cs.CL cs.LGcited by 1

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Personalized LLM agents maintain persistent cross-session state to support long-horizon collaboration. Yet, this persistence introduces a subtle but critical security vulnerability: routine user-agent interactions can gradually reshape an agent's long-term state, inadvertently weakening future confirmation boundaries, expanding tool-use defaults, and escalating autonomous behavior over time. We formalize this risk as unintended long-term state poisoning. To systematically study it, we introduce the Unintended Long-Term State Poisoning Bench (ULSPB), a bilingual benchmark comprising 350 settings spanning five assistance categories, seven interaction patterns, 24-turn routine interactions, and matched single-injection counterparts. Furthermore, we define the Harm Score (HS), a state-centric metric that quantifies authorization drift, tool-use escalation, and unchecked autonomy. Experiments on OpenClaw with four backbone LLMs demonstrate that, while single-injection is generally effective, routine conversations alone can substantially poison long-term state, primarily corrupting memory-centric artifacts. Evaluations seeded with real-world user interactions confirm that this risk is not a mere artifact of synthetic prompts. To mitigate this threat, we propose StateGuard, a lightweight, post-execution defense that audits state diffs at the writeback boundary and selectively rolls back dangerous edits. Across all evaluated models, StateGuard reduces HS to near zero and lowers false-negative rates, with acceptable high false-positive rates under a safety-first writeback defense and minimal overhead.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 35 of its 37 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

35 of 37 references.

Closest ancestors · 20

Same direction, newest first

  1. 2026TraceSafe: A Systematic Assessment of LLM Guardrails on Multi-Step Tool-Calling Trajectories8 Apr
  2. 2026SkillTrojan: Backdoor Attacks on Skill-Based Agent Systems8 Apr
  3. 2026Your Agent, Their Asset: A Real-World Safety Analysis of OpenClaw6 Apr
  4. 2026ClawSafety: "Safe" LLMs, Unsafe Agents1 Apr
  5. 2026AgentWorm: Self-Propagating Attacks Across LLM Agent Ecosystems16 Mar
  6. 2026From Storage to Steering: Memory Control Flow Attacks on LLM Agents16 Mar
  7. 2026OpenClaw PRISM: A Zero-Fork, Defense-in-Depth Runtime Security Layer for Tool-Augmented LLM Agents12 Mar
  8. 2026Taming OpenClaw: Security Analysis and Mitigation of Autonomous LLM Agent Threats12 Mar
  9. 2026Clawdrain: Exploiting Tool-Calling Chains for Stealthy Token Exhaustion in OpenClaw Agents1 Mar
  10. 2026AgentSentry: Mitigating Indirect Prompt Injection in LLM Agents via Temporal Causal Diagnostics and Context Purification26 Feb
  11. 2026Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injections17 Feb
  12. 2026From Assistant to Double Agent: Formalizing and Benchmarking Attacks on OpenClaw for Personalized Local AI Agent9 Feb
8 more
  1. 2026When Benign Inputs Lead to Severe Harms: Eliciting Unsafe Unintended Behaviors of Computer-Use Agents9 Feb
  2. 2025VeriGuard: Enhancing LLM Agent Safety via Verified Code Generation3 Oct
  3. 2025ProbGuard: Proactive Runtime Monitoring for LLM Agent Safety via Probabilistic Prediction1 Aug
  4. 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
  5. 2025Safety at Scale: A Comprehensive Survey of Large Model and Agent Safety2 Feb
  6. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
  7. 2024Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents3 Oct
  8. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Bases17 Jul

Other references · 15

  1. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  2. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  3. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  4. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
  5. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 461
  6. 2023Detecting Language Model Attacks with Perplexitycited by 431
  7. 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 368
  8. 2023Formalizing and Benchmarking Prompt Injection Attacks and Defensescited by 364
  9. 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 323
  10. 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
  11. 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agentscited by 64
  12. 2024Caution for the Environment: Multimodal LLM Agents are Susceptible to Environmental Distractionscited by 56
3 more
  1. 2025A Survey of Classification Tasks and Approaches for Legal Contractscited by 6
  2. 2026Autonomous Action Runtime Management(AARM):A System Specification for Securing AI-Driven Actions at Runtimecited by 5
  3. 2026Mind Your HEARTBEAT! Claw Background Execution Inherently Enables Silent Memory Pollutioncited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026No Attacker Needed: Unintentional Cross-User Contamination in Shared-State LLM Agents
  2. 2026Hidden in Memory: Sleeper Memory Poisoning in LLM Agents
  3. 2026Towards a Unified Misuse Monitoring Benchmark
  4. 2026The Cold-Start Safety Gap in LLM Agents
  5. 2026When Personalization Legitimizes Risks: Uncovering Safety Vulnerabilities in Personalized Dialogue Agents
  6. 2025ChatInject: Abusing Chat Templates for Prompt Injection in LLM Agents
  7. 2025MURMUR: Using cross-user chatter to break collaborative language agents in groups
  8. 2026Differential Harm Propensity in Personalized LLM Agents: The Curious Case of Mental Health Disclosure