AutoAdv: Automated Adversarial Prompting for Multi-Turn Jailbreaking of Large Language Models
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large Language Models (LLMs) remain vulnerable to jailbreaking attacks where adversarial prompts elicit harmful outputs. Yet most evaluations focus on single-turn interactions while real-world attacks unfold through adaptive multi-turn conversations. We present AutoAdv, a training-free framework for automated multi-turn jailbreaking that achieves an attack success rate of up to 95% on Llama-3.1-8B within six turns, a 24% improvement over single-turn baselines. AutoAdv uniquely combines three adaptive mechanisms: a pattern manager that learns from successful attacks to enhance future prompts, a temperature manager that dynamically adjusts sampling parameters based on failure modes, and a two-phase rewriting strategy that disguises harmful requests and then iteratively refines them. Extensive evaluation across commercial and open-source models (Llama-3.1-8B, GPT-4o mini, Qwen3-235B, Mistral-7B) reveals persistent vulnerabilities in current safety mechanisms, with multi-turn attacks consistently outperforming single-turn approaches. These findings demonstrate that alignment strategies optimized for single-turn interactions fail to maintain robustness across extended conversations, highlighting an urgent need for multi-turn-aware defenses.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 16 of its 65 references that are in the map. First posted on arXiv 4 Nov 2025.
Builds on
16 of 65 references.
Closest ancestors · 10
Same direction, newest first
- 2025Tempest: Autonomous Multi-Turn Jailbreaking of Large Language Models with Tree Search13 Mar
- 2024Jailbreaking and Mitigation of Vulnerabilities in Large Language Models20 Oct
- 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMs3 Oct
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet27 Aug
- 2024Human-Interpretable Adversarial Prompt Attack on Large Language Models with Situational Context19 Jul
- 2024AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs21 Apr
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack2 Apr
- 2024Leveraging the Context through Multi-Round Interactions for Jailbreaking Attacks14 Feb
- 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 6
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
- 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Promptscited by 189
- 2024ImgTrojan: Jailbreaking Vision-Language Models with ONE Imagecited by 50
- 2024Automated Red Teaming with GOAT: the Generative Offensive Agent Testercited by 41
Built on by
Not cited yet.