Jailbreaking? One Step Is Enough!
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large language models (LLMs) excel in various tasks but remain vulnerable to jailbreak attacks, where adversaries manipulate prompts to generate harmful outputs. Examining jailbreak prompts helps uncover the shortcomings of LLMs. However, current jailbreak methods and the target model's defenses are engaged in an independent and adversarial process, resulting in the need for frequent attack iterations and redesigning attacks for different models. To address these gaps, we propose a Reverse Embedded Defense Attack (REDA) mechanism that disguises the attack intention as the "defense". intention against harmful content. Specifically, REDA starts from the target response, guiding the model to embed harmful content within its defensive measures, thereby relegating harmful content to a secondary role and making the model believe it is performing a defensive task. The attacking model considers that it is guiding the target model to deal with harmful content, while the target model thinks it is performing a defensive task, creating an illusion of cooperation between the two. Additionally, to enhance the model's confidence and guidance in "defensive" intentions, we adopt in-context learning (ICL) with a small number of attack examples and construct a corresponding dataset of attack examples. Extensive evaluations demonstrate that the REDA method enables cross-model attacks without the need to redesign attack strategies for different models, enables successful jailbreak in one iteration, and outperforms existing methods on both open-source and closed-source models.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 25 of its 34 references that are in the map. First posted on arXiv 17 Dec 2024.
Builds on
25 of 34 references.
Closest ancestors · 10
Same direction, newest first
- 2024Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise and Reconstruction28 Feb
- 2024SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding14 Feb
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs12 Jan
- 2023A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easily14 Nov
- 2023DeepInception: Hypnotize Large Language Model to Be Jailbreaker6 Nov
- 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
- 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts19 Sep
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
- 2023MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbots16 Jul
- 2023Jailbroken: How Does LLM Safety Training Fail?5 Jul
Other references · 15
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 415
- 2023Automatically Auditing Large Language Models via Discrete Optimizationcited by 187
- 2023Unified Demonstration Retriever for In-Context Learningcited by 141
3 more
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2025Prefill-level Jailbreak: A Black-Box Risk Analysis of Large Language Modelscited by 9
- 2026Defending Large Language Models Against Jailbreak Attacks via In-Decoding Safety-Awareness Probingcited by 4
- 2025ASTRA: An Automated Framework for Strategy Discovery, Retrieval, and Evolution for Jailbreaking LLMscited by 1
- 2026EvoJail: Evolutionary Diverse Jailbreak Prompt Generation for Large Language Modelscited by 1
- 2026Hard to Read, Easy to Jailbreak: How Visual Degradation Bypasses MLLM Safety Alignmentcited by 1
- 2026Attributing and Exploiting Safety Vectors through Global Optimization in Large Language Modelscited by 0
- 2026Mitigating Many-shot Jailbreak Attacks with One Single Demonstrationcited by 0
- 2026Babel: Jailbreaking Safety Attention via Obfuscation Distribution Optimized Samplingcited by 0
- 2026Babel: Jailbreaking Safety Attention via Obfuscation Distribution Optimized Sampling18 May 2026
- 2026Mitigating Many-shot Jailbreak Attacks with One Single Demonstration8 May 2026
- 2026Hard to Read, Easy to Jailbreak: How Visual Degradation Bypasses MLLM Safety Alignment8 May 2026
- 2026EvoJail: Evolutionary Diverse Jailbreak Prompt Generation for Large Language Models22 Apr 2026
- 2026Attributing and Exploiting Safety Vectors through Global Optimization in Large Language Models22 Jan 2026
- 2026Defending Large Language Models Against Jailbreak Attacks via In-Decoding Safety-Awareness Probing15 Jan 2026
- 2025ASTRA: An Automated Framework for Strategy Discovery, Retrieval, and Evolution for Jailbreaking LLMs4 Nov 2025
- 2025Prefill-level Jailbreak: A Black-Box Risk Analysis of Large Language Models28 Apr 2025