mlsanityData to 7 Oct 2026

AutoAdv: Automated Adversarial Prompting for Multi-Turn Jailbreaking of Large Language Models

arXiv 2511.02376 ↗First posted 4 Nov 2025cs.CL cs.AI cs.CRcited by 0

On the map: LLM safety and security → Jailbreaking

Abstract (arXiv)

Large Language Models (LLMs) remain vulnerable to jailbreaking attacks where adversarial prompts elicit harmful outputs. Yet most evaluations focus on single-turn interactions while real-world attacks unfold through adaptive multi-turn conversations. We present AutoAdv, a training-free framework for automated multi-turn jailbreaking that achieves an attack success rate of up to 95% on Llama-3.1-8B within six turns, a 24% improvement over single-turn baselines. AutoAdv uniquely combines three adaptive mechanisms: a pattern manager that learns from successful attacks to enhance future prompts, a temperature manager that dynamically adjusts sampling parameters based on failure modes, and a two-phase rewriting strategy that disguises harmful requests and then iteratively refines them. Extensive evaluation across commercial and open-source models (Llama-3.1-8B, GPT-4o mini, Qwen3-235B, Mistral-7B) reveals persistent vulnerabilities in current safety mechanisms, with multi-turn attacks consistently outperforming single-turn approaches. These findings demonstrate that alignment strategies optimized for single-turn interactions fail to maintain robustness across extended conversations, highlighting an urgent need for multi-turn-aware defenses.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 16 of its 65 references that are in the map. First posted on arXiv 4 Nov 2025.

Builds on

16 of 65 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Tempest: Autonomous Multi-Turn Jailbreaking of Large Language Models with Tree Search13 Mar
  2. 2024Jailbreaking and Mitigation of Vulnerabilities in Large Language Models20 Oct
  3. 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMs3 Oct
  4. 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet27 Aug
  5. 2024Human-Interpretable Adversarial Prompt Attack on Large Language Models with Situational Context19 Jul
  6. 2024AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs21 Apr
  7. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack2 Apr
  8. 2024Leveraging the Context through Multi-Round Interactions for Jailbreaking Attacks14 Feb
  9. 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
  10. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 6

  1. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  2. 2022Red Teaming Language Models with Language Modelscited by 983
  3. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
  4. 2024Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Promptscited by 189
  5. 2024ImgTrojan: Jailbreaking Vision-Language Models with ONE Imagecited by 50
  6. 2024Automated Red Teaming with GOAT: the Generative Offensive Agent Testercited by 41

Built on by

Not cited yet.