mlsanityData to 14 Oct 2026

X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems

arXiv 2610.13886 ↗First posted 9 Oct 2026cs.AIcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance also fits: Software engineering coding agents

also in 1 more
Abstract (arXiv)

Personal agents increasingly connect to services across the web and applications by using tools. As the effects of their actions accumulate and interact across services, unintended or harmful outcomes can arise when agents fulfill benign user requests. Proactively identifying these compositional failures requires systematically exploring diverse cross-service paths. Existing red-teaming methods often simply prompt LLMs to identify potentially harmful paths from task and environment descriptions or decompose harmful objectives specified by humans or LLMs into seemingly benign action combinations. However, generation is biased toward patterns learned during training, potentially favoring familiar tool combinations and leaving novel cross-service interactions underexplored. To address this, we propose X-AgentRed, a self-evolving red-teaming framework that discovers harmful tool call paths through a graph of tool dependencies and expands and refines them using execution feedback. By analyzing each tool's effects, potential harms, and preconditions for execution, the red-teaming agent constructs a directed graph that captures how one tool's effects can satisfy another's execution preconditions. Recipes sampled from this graph are instantiated as realistic scenarios in which agents can produce harmful outcomes. Execution feedback enables self-improvement by diversifying paths that produce harm through tool substitution and refining preconditions at blocked steps in unsuccessful paths to enable further execution. Across four frontier agentic models, X-AgentRed achieves 1.77× the harmful path rate of STAC and explores a more diverse set of tools, yielding 2.99× the tool coverage on average.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 16 of its 27 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

16 of 27 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026TRACE: Task-Aware Adaptive Self-Evolving Agentic Jailbreaking29 May
  2. 2026Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Agents13 Feb
  3. 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents15 Apr
  4. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
  5. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
  6. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 10

  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  2. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  3. 2022Red Teaming Language Models with Language Modelscited by 1,026
  4. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  5. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
  6. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
  7. 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Promptscited by 205
  8. 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMscited by 199
  9. 2024Curiosity-driven Red-teaming for Large Language Modelscited by 88
  10. 2025Quality-Diversity Red-Teaming: Automated Generation of High-Quality and Diverse Attackers for Large Language Modelscited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Proteus: A Self-Evolving Red Team for Agent Skill Ecosystems
  2. 2026Governing Execution Risk in Agentic AI Systems: A Trajectory-Guided Framework for Red Teaming
  3. 2026AgenticRed: Evolving Agentic Systems for Red-Teaming
  4. 2026RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill Evolution
  5. 2026REDAgentBench: Executable Red Teaming and Faithful Measurement of LLM Agent Systems
  6. 2026CART: Closed-Loop Adaptive Red Teaming for Large Language Models
  7. 2024ST-WebAgentBench: A Benchmark for Evaluating Safety and Trustworthiness in Web Agents
  8. 2026The Tool Illusion: Rethinking Tool Use in Web Agents