PLAGUE: Plug-and-play framework for Lifelong Adaptive Generation of Multi-turn Exploits
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large Language Models (LLMs) are improving at an exceptional rate. With the advent of agentic workflows, multi-turn dialogue has become the de facto mode of interaction with LLMs for completing long and complex tasks. While LLM capabilities continue to improve, they remain increasingly susceptible to jailbreaking, especially in multi-turn scenarios where harmful intent can be subtly injected across the conversation to produce nefarious outcomes. While single-turn attacks have been extensively explored, adaptability, efficiency and effectiveness continue to remain key challenges for their multi-turn counterparts. To address these gaps, we present PLAGUE, a novel plug-and-play framework for designing multi-turn attacks inspired by lifelong-learning agents. PLAGUE dissects the lifetime of a multi-turn attack into three carefully designed phases (Primer, Planner and Finisher) that enable a systematic and information-rich exploration of the multi-turn attack family. Evaluations show that red-teaming agents designed using PLAGUE achieve state-of-the-art jailbreaking results, improving attack success rates (ASR) by more than 30% across leading models in a lesser or comparable query budget. Particularly, PLAGUE enables an ASR (based on StrongReject) of 81.4% on OpenAI's o3 and 67.3% on Claude's Opus 4.1, two models that are considered highly resistant to jailbreaks in safety literature. Our work offers tools and insights to understand the importance of plan initialization, context optimization and lifelong learning in crafting multi-turn attacks for a comprehensive model vulnerability evaluation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 32 of its 53 references that are in the map. First posted on arXiv 20 Oct 2025.
Builds on
32 of 53 references.
Closest ancestors · 13
Same direction, newest first
- 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents15 Apr
- 2025Foot-In-The-Door: A Multi-turn Jailbreak for LLMs27 Feb
- 2025Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Models16 Feb
- 2024Best-of-N Jailbreaking4 Dec
- 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMs3 Oct
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet27 Aug
- 2024h4rm3l: A language for Composable Jailbreak Attack Synthesis9 Aug
- 2024Jailbreaking Large Language Models Against Moderation Guardrails via Cipher Characters30 May
- 2024AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs21 Apr
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack2 Apr
- 2024EasyJailbreak: A Unified Framework for Jailbreaking Large Language Models18 Mar
- 2024A StrongREJECT for Empty Jailbreaks15 Feb
1 more
Other references · 19
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2023Are aligned neural networks adversarially aligned?cited by 315
- 2024TextGrad: Automatic "Differentiation" via Textcited by 273
- 2020MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformerscited by 245
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
7 more
- 2024LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shiftscited by 86
- 2023FLIRT: Feedback Loop In-context Red Teamingcited by 83
- 2024Automated Red Teaming with GOAT: the Generative Offensive Agent Testercited by 45
- 2025AutoRedTeamer: Autonomous Red Teaming with Lifelong Attack Integrationcited by 43
- 2025Lessons from Defending Gemini Against Indirect Prompt Injectionscited by 43
- 2025LLM-Safety Evaluations Lack Robustnesscited by 18
- 2024Does Safety Training of LLMs Generalize to Semantically Related Natural Prompts?cited by 15
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026EvoFlint: An Evolutionary Atlas of Multi-Turn LLM Vulnerabilities
- 2025Amplified Vulnerabilities: Structured Jailbreak Attacks on LLM-based Multi-Agent Debate
- 2026A Self-Evolving Multi-Agent Framework Defense against LLM Jailbreak Attacks
- 2025Echoes of Human Malice in Agents: Benchmarking LLMs for Multi-Turn Online Harassment Attacks
- 2025Chain-of-Lure: A Universal Jailbreak Attack Framework using Unconstrained Synthetic Narratives
- 2025GRAF: Multi-turn Jailbreaking via Global Refinement and Active Fabrication
- 2024PathSeeker: Exploring LLM Security Vulnerabilities with a Reinforcement Learning-Based Jailbreak Approach
- 2026Knowledge-Driven Multi-Turn Jailbreaking on Large Language Models