mlsanityData to 7 Oct 2026

T-MAP: Red-Teaming LLM Agents with Trajectory-aware Evolutionary Search

arXiv 2603.22341 ↗First posted 21 Mar 2026cs.CR cs.AI cs.CLcited by 6

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

While prior red-teaming efforts have focused on eliciting harmful text outputs from large language models (LLMs), such approaches fail to capture agent-specific vulnerabilities that emerge through multi-step tool execution, particularly in rapidly growing ecosystems such as the Model Context Protocol (MCP). To address this gap, we propose a trajectory-aware evolutionary search method, T-MAP, which leverages execution trajectories to guide the discovery of adversarial prompts. Our approach enables the automatic generation of attacks that not only bypass safety guardrails but also reliably realize harmful objectives through actual tool interactions. Empirical evaluations across diverse MCP environments demonstrate that T-MAP substantially outperforms baselines in attack realization rate (ARR) and remains effective against frontier models, including GPT-5.2, Gemini-3-Pro, Qwen3.5, and GLM-5, thereby revealing previously underexplored vulnerabilities in autonomous LLM agents. Code is available at https://github.com/pwnhyo/T-MAP.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 22 of its 30 references that are in the map. First posted on arXiv 21 Mar 2026.

Builds on

22 of 30 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025SIRAJ: Diverse and Efficient Red-Teaming for LLM Agents via Distilled Structured Reasoning30 Oct
  2. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
  3. 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents11 Oct
  4. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan

Other references · 18

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  4. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  5. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  6. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
  7. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  8. 2022Red Teaming Language Models with Language Modelscited by 983
  9. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 619
  10. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
  11. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  12. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
6 more
  1. 2015Illuminating search spaces by mapping elitescited by 406
  2. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 364
  3. 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Promptscited by 189
  4. 2025The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against Llm Jailbreaks and Prompt Injectionscited by 108
  5. 2024Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLMcited by 73
  6. 2025Adversarial Reasoning at Jailbreaking Timecited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Automatic Red Teaming LLM-based Agents with Model Context Protocol Tools
  2. 2024Against The Achilles' Heel: A Survey on Red Teaming for Generative Models
  3. 2026TreeTeaming: Autonomous Red-Teaming of Vision-Language Models via Hierarchical Strategy Exploration
  4. 2026OpenRT: An Open-Source Red Teaming Framework for Multimodal LLMs
  5. 2025Genesis: Evolving Attack Strategies for LLM Web Agent Red-Teaming
  6. 2026AgenticRed: Evolving Agentic Systems for Red-Teaming
  7. 2026REDAgentBench: Executable Red Teaming and Faithful Measurement of LLM Agent Systems
  8. 2026RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill Evolution