Pattern Enhanced Multi-Turn Jailbreaking: Exploiting Structural Vulnerabilities in Large Language Models
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large language models (LLMs) remain vulnerable to multi-turn jailbreaking attacks that exploit conversational context to bypass safety constraints gradually. These attacks target different harm categories through distinct conversational approaches. Existing multi-turn methods often rely on heuristic or ad hoc exploration strategies, providing limited insight into underlying model weaknesses. The relationship between conversation patterns and model vulnerabilities across harm categories remains poorly understood. We propose Pattern Enhanced Chain of Attack (PE-CoA), a framework of five conversation patterns to construct multi-turn jailbreaks through natural dialogue. Evaluating PE-CoA on twelve LLMs spanning ten harm categories, we achieve state-of-the-art performance, uncovering pattern-specific vulnerabilities and LLM behavioral characteristics: models exhibit distinct weakness profiles, defense to one pattern does not generalize to others, and model families share similar failure modes. These findings highlight limitations of safety training and indicate the need for pattern-aware defenses. Code available on: https://github.com/Ragib-Amin-Nihal/PE-CoA
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 32 of its 59 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
32 of 59 references.
Closest ancestors · 13
Same direction, newest first
- 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents15 Apr
- 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMs3 Oct
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet27 Aug
- 2024Multi-Turn Context Jailbreak Attack on Large Language Models From First Principles8 Aug
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack2 Apr
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automatically4 Dec
- 2023Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization15 Nov
- 2023Self-Guard: Empower the LLM to Safeguard Itself24 Oct
- 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
- 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations10 Oct
- 2023Low-Resource Languages Jailbreak GPT-43 Oct
- 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher12 Aug
Other references · 19
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 657
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
- 2022Improving alignment of dialogue agents via targeted human judgementscited by 527
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
- 2023Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attackscited by 268
- 2023Pretraining Language Models with Human Preferencescited by 245
- 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 218
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 191
7 more
- 2023MART: Improving LLM Safety with Multi-round Automatic Red-Teamingcited by 161
- 2019Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overviewcited by 137
- 2024Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLMcited by 73
- 2024Learning diverse attacks on large language models for robust red-teaming and safety tuningcited by 54
- 2024Automated Red Teaming with GOAT: the Generative Offensive Agent Testercited by 41
- 2024Membership Inference Attacks Against In-Context Learningcited by 38
- 2025Strategize Globally, Adapt Locally: A Multi-Turn Red Teaming Agent with Dual-Level Learningcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.