mlsanityData to 7 Oct 2026

AJAR: Adaptive Jailbreak Architecture for Red-teaming

arXiv 2601.10971 ↗First posted 16 Jan 2026cs.CR cs.CLcited by 1

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Large language model (LLM) safety evaluation is moving from content moderation to action security as modern systems gain persistent state, tool access, and autonomous control loops. Existing jailbreak frameworks still leave a gap between adaptive multi-turn attacks and agentic runtimes: attack algorithms are usually packaged as monolithic scripts, while agent harnesses rarely expose explicit abstractions for rollback, tool simulation, or strategy switching. We present AJAR, a red-teaming framework that exposes multi-turn jailbreak algorithms as callable MCP services and lets an Auditor Agent orchestrate them inside a tool-aware runtime built on Petri. AJAR integrates three representative attacks, namely Crescendo, ActorAttack, and X-Teaming, under a shared service interface for planning, prompt generation, optimization, evaluation, and context control. On 200 HarmBench validation behaviors, AJAR improves X-Teaming from 65.0% to 76.0% attack success rate (ASR), reaches 80% cumulative success one turn earlier than the native implementation, and reproduces Crescendo more effectively than PyRIT (91.0% vs. 87.5% ASR). Behavior-level analysis shows that these gains are concentrated in hard categories and frequently depend on rollback-enabled transcript repair. We further show that tool access reshapes rather than uniformly enlarges the attack surface: ActorAttack rises from 51.0% to 56.0% ASR with tools, whereas Crescendo drops from 91.0% to 78.0% and X-Teaming from 76.0% to 55.5%, with the sharpest declines appearing in categories that rely on long semantic buildup. These results position AJAR as a practical foundation for evaluating multi-turn jailbreaks under realistic agent constraints. Code and data are available at https://github.com/douyipu/ajar.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 14 of its 23 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

14 of 23 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026OpenRT: An Open-Source Red Teaming Framework for Multimodal LLMs4 Jan
  2. 2025Evolve the Method, Not the Prompts: Evolutionary Synthesis of Jailbreak Attacks on LLMs16 Nov
  3. 2025RedCodeAgent: Automatic Red-teaming Agent against Diverse Code Agents2 Oct
  4. 2024PyRIT: A Framework for Security Risk Identification and Red Teaming in Generative AI System1 Oct
  5. 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts26 Feb
  6. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal6 Feb

Other references · 8

  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  2. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
  3. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  4. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  5. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 364
  6. 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agentscited by 112
  7. 2024LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shiftscited by 80
  8. 2024EasyJailbreak: A Unified Framework for Jailbreaking Large Language Modelscited by 57

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill Evolution
  2. 2025CoP: Agentic Red-teaming for Large Language Models using Composition of Principles
  3. 2025Jailbreak-R1: Exploring the Jailbreak Capabilities of LLMs via Reinforcement Learning
  4. 2026A Self-Evolving Multi-Agent Framework Defense against LLM Jailbreak Attacks
  5. 2025Red-Teaming Coding Agents from a Tool-Invocation Perspective: An Empirical Security Assessment
  6. 2025Strategize Globally, Adapt Locally: A Multi-Turn Red Teaming Agent with Dual-Level Learning
  7. 2024RedAgent: Red Teaming Large Language Models with Context-aware Autonomous Language Agent
  8. 2026OrchJail: Jailbreaking Tool-Calling Text-to-Image Agents by Orchestration-Guided Fuzzing