Break Me If You Can: Self-Jailbreaking of Aligned LLMs via Lexical Insertion Prompting
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
We introduce self-jailbreaking, a threat model in which an aligned LLM guides its own compromise. Unlike most jailbreak techniques, which often rely on handcrafted prompts or separate attacker models, self-jailbreaking requires no external red-team LLM: the target model's own internal knowledge suffices. We operationalize this via textbfSelf-Jailbreaking via Lexical Insertion Prompting (textscSLIP), a black-box algorithm that casts jailbreaking as breadth-first tree search over multi-turn dialogues, incrementally inserting missing content words from the attack goal into benign prompts using the target model as its own guide. Evaluations on AdvBench and HarmBench show textscSLIP achieves 90--100% Attack Success Rate (ASR) (avg. 94.7%) across most of the eleven tested models (including GPT-5.1, Claude-Sonnet-4.5, Gemini-2.5-Pro, and DeepSeek-V3), with only ~7.9 LLM calls on average, 3--6× fewer than prior methods. We evaluate existing defenses, show that regex-based approaches are evaded by prompt paraphrasing, and propose the Semantic Drift Monitor (SDM) defense that tracks textscSLIP's embedding-space trajectory, achieving 76% detection at 5% FPR. However, SDM remains insufficient against adaptive attack strategies, underscoring the need for more advanced defense mechanisms tailored to the self-jailbreaking threat surface. We release our code for reproducibility.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 30 of its 36 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
30 of 36 references.
Closest ancestors · 19
Same direction, newest first
- 2025Self-Jailbreaking: Language Models Can Reason Themselves Out of Safety Alignment After Benign Reasoning Training23 Oct
- 2025InfoFlood: Jailbreaking Large Language Models with Information Overload13 Jun
- 2025X-Teaming: Multi-Turn Jailbreaks and Defenses with Adaptive Multi-Agents15 Apr
- 2025Reasoning-Augmented Conversation for Multi-Turn Jailbreak Attacks on Large Language Models16 Feb
- 2024Diversity Helps Jailbreak Large Language Models6 Nov
- 2024Endless Jailbreaks with Bijection Learning2 Oct
- 2024Improved Techniques for Optimization-Based Jailbreaking on Large Language Models31 May
- 2024Jailbreaking Large Language Models Against Moderation Guardrails via Cipher Characters30 May
- 2024Boosting Jailbreak Attack with Momentum2 May
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks2 Apr
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack2 Apr
- 2024Fight Back Against Jailbreaking via Prompt Adversarial Tuning9 Feb
7 more
- 2024JailbreakRadar: Comprehensive Assessment of Jailbreak Attacks Against LLMs8 Feb
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automatically4 Dec
- 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
- 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations10 Oct
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks5 Oct
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 11
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 493
- 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 83
- 2024Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLMcited by 77
- 2023Artificial intelligence and biological misuse: Differentiating risks of language models and biological design toolscited by 45
- 2025Beyond Consensus: Mitigating the Agreeableness Bias in LLM Judge Evaluationscited by 16
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Formalization Driven LLM Prompt Jailbreaking via Reinforcement Learning
- 2024Defensive Prompt Patch: A Robust and Interpretable Defense of LLMs against Jailbreak Attacks
- 2025Involuntary Jailbreak: On Self-Prompting Attacks
- 2024DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers
- 2024SelfDefend: LLMs Can Defend Themselves against Jailbreaking in a Practical Manner
- 2025Forewarned is Forearmed: Pre-Synthesizing Jailbreak-like Instructions to Enhance LLM Safety Guardrail to Potential Attacks
- 2026Reactivating Alignment: Defending LLMs from Jailbreaks via Intention-Aware Input-Output Matching
- 2026The Art of the Jailbreak: Formulating Jailbreak Attacks for LLM Security Beyond Binary Scoring