mlsanityData to 7 Oct 2026

Agents of Chaos

arXiv 2602.20021 ↗First posted 23 Feb 2026cs.AI cs.CYcited by 24

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

We report an exploratory red-teaming study of autonomous language-model-powered agents deployed in a live laboratory environment with persistent memory, email accounts, Discord access, file systems, and shell execution. Over a two-week period, twenty AI researchers interacted with the agents under benign and adversarial conditions. Focusing on failures emerging from the integration of language models with autonomy, tool use, and multi-party communication, we document eleven representative case studies. Observed behaviors include unauthorized compliance with non-owners, disclosure of sensitive information, execution of destructive system-level actions, denial-of-service conditions, uncontrolled resource consumption, identity spoofing vulnerabilities, cross-agent propagation of unsafe practices, and partial system takeover. In several cases, agents reported task completion while the underlying system state contradicted those reports. We also report on some of the failed attempts. Our findings establish the existence of security-, privacy-, and governance-relevant vulnerabilities in realistic deployment settings. These behaviors raise unresolved questions regarding accountability, delegated authority, and responsibility for downstream harms, and warrant urgent attention from legal scholars, policymakers, and researchers across disciplines. This report serves as an initial empirical contribution to that broader conversation.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. First posted on arXiv 23 Feb 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 24.

24 papers.

Sort:

By area:

  1. 2026ClawSafety: "Safe" LLMs, Unsafe Agentscited by 15
  2. 2026How Your Credentials Are Leaked by LLM Agent Skills: An Empirical Studycited by 14
  3. 2026SafetyDrift: Predicting When AI Agents Cross the Line Before They Actually Docited by 4
  4. 2026Towards Security-Auditable LLM Agents: A Unified Graph Representationcited by 4
  5. 2026Coding with "Enemy": Can Human Developers Detect AI Agent Sabotage?cited by 4
  6. 2026Caging the Agents: A Zero Trust Security Architecture for Autonomous AI in Healthcarecited by 3
  7. 2026ClawTrap: A MITM-Based Red-Teaming Framework for Real-World OpenClaw Security Evaluationcited by 3
  8. 2026Stable Agentic Control: Tool-Mediated LLM Architecture for Autonomous Cyber Defensecited by 3
  9. 2026LivePI: More Realistic Benchmarking of Agents Against Indirect Prompt Injectioncited by 3
  10. 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Webcited by 2
  11. 2026SentinelAgent: Intent-Verified Delegation Chains for Securing Federal Multi-Agent AI Systemscited by 2
  12. 2026Improving the Efficiency of Language Agent Teams with Adaptive Task Graphscited by 2
12 more
  1. 2026Agent-ValueBench: A Comprehensive Benchmark for Evaluating Agent Valuescited by 2
  2. 2026The Authorization-Execution Gap Is a Major Safety and Security Problem in Open-World Agentscited by 2
  3. 2026Real-Time AI Service Economy: A Framework for Agentic Computing Across the Continuumcited by 1
  4. 2026Agent Meltdowns: The Road to Hell Is Paved with Helpful Agentscited by 1
  5. 2026Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasurescited by 1
  6. 2026Solipsistic Superintelligence is Unlikely to be Cooperativecited by 1
  7. 2026Conversable Complexity: Agentic LLM Collectives as Interpretable Substratescited by 1
  8. 2026Is Decentralized AI Governable? From Regulative Policy to Constitutive Protocolcited by 0
  9. 2026Honeyquest for LLMs: Rethinking Cyber Deception for AI Attackerscited by 0
  10. 2026RePolicy: Reinforcement Learning for Safety-Policy Invocation in Agent Safeguardscited by 0
  11. 2026Agentic Societies Need a Social Harnesscited by 0
  12. 2026MiniRep: Robust Reputation-Based Aggregation for Multi-Agent Debatecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Security Challenges in AI Agent Deployment: Insights from a Large Scale Public Competition
  2. 2026Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks
  3. 2025Agentic AI Security: Threats, Defenses, Evaluation, and Open Challenges
  4. 2025A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents
  5. 2026Cyber-Capable AI Agents: Vulnerabilities, Evaluation Containment, and Defensive Response
  6. 2026REDAgentBench: Executable Red Teaming and Faithful Measurement of LLM Agent Systems
  7. 2026Autonomous Adversary: Red-Teaming in the age of LLM
  8. 2026The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey