mlsanityData to 14 Oct 2026

Chain-of-Lure: A Universal Jailbreak Attack Framework using Unconstrained Synthetic Narratives

arXiv 2505.17519 ↗First posted 23 May 2025cs.CR cs.CLcited by 5

On the map: LLM safety and security → Jailbreaking

Abstract (arXiv)

In the era of rapid generative AI development, interactions with large language models (LLMs) pose increasing risks of misuse. Prior research has primarily focused on attacks using template-based prompts and optimization-oriented methods, while overlooking the fact that LLMs possess strong unconstrained deceptive capabilities to attack other LLMs. This paper introduces a novel jailbreaking method inspired by the Chain-of-Thought mechanism. The attacker employs mission transfer to conceal harmful user intent within dialogue and generates a progressive chain of lure questions without relying on predefined templates, enabling successful jailbreaks. To further improve the attack's strength, we incorporate a helper LLM model that performs randomized narrative optimization over multi-turn interactions, enhancing the attack performance while preserving alignment with the original intent. We also propose a toxicity-based framework using third-party LLMs to evaluate harmful content and its alignment with malicious intent. Extensive experiments demonstrate that our method consistently achieves high attack success rates and elevated toxicity scores across diverse types of LLMs under black-box API settings. These findings reveal the intrinsic potential of LLMs to perform unrestricted attacks in the absence of robust alignment constraints. Our approach offers data-driven insights to inform the design of future alignment mechanisms. Finally, we propose two concrete defense strategies to support the development of safer generative models. Our code is available at https://github.com/ChangWenhan/chain-of-lure-official

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 26 of its 28 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

26 of 28 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025Playing the Fool: Jailbreaking LLMs and Multimodal LLMs with Out-of-Distribution Strategy26 Mar
  2. 2024MRJ-Agent: An Effective Jailbreak Agent for Multi-Round Dialogue6 Nov
  3. 2024Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses3 Jun
  4. 2024Improved Techniques for Optimization-Based Jailbreaking on Large Language Models31 May
  5. 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMs11 Apr
  6. 2024A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Models21 Feb
  7. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automatically4 Dec
  8. 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
  9. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
  10. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts19 Sep
  11. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 15

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023A Survey of Large Language Modelscited by 2,576
  3. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  4. 2022Red Teaming Language Models with Language Modelscited by 1,026
  5. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
  6. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 472
  7. 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 294
  8. 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 186
  9. 2024Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmeticcited by 112
  10. 2024LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shiftscited by 86
  11. 2024White-box Multimodal Jailbreaks Against Large Vision-Language Modelscited by 59
  12. 2024Language Models Resist Alignment: Evidence From Data Compressioncited by 53
3 more
  1. 2024PAL: Proxy-Guided Black-Box Attack on Large Language Modelscited by 50
  2. 2024Safety Arithmetic: A Framework for Test-time Safety Alignment of Language Models by Steering Parameters and Activationscited by 32
  3. 2024Zer0-Jack: A Memory-efficient Gradient-based Jailbreaking Method for Black-box Multi-modal Large Language Modelscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Jailbreak Mimicry: Automated Discovery of Narrative-Based Jailbreaks for Large Language Models
  2. 2026Compositional Jailbreaking: An Empirical Analysis of Mutator Chain Interactions in Aligned LLMs
  3. 2025Stand on The Shoulders of Giants: Building JailExpert from Previous Attack Experience
  4. 2025Anyone Can Jailbreak: Prompt-Based Attacks on LLMs and T2Is
  5. 2025GRAF: Multi-turn Jailbreaking via Global Refinement and Active Fabrication
  6. 2025AutoAdv: Automated Adversarial Prompting for Multi-Turn Jailbreaking of Large Language Models
  7. 2025Dialogue Injection Attack: Jailbreaking LLMs through Context Manipulation
  8. 2024Leveraging the Context through Multi-Round Interactions for Jailbreaking Attacks