Guiding not Forcing: Enhancing the Transferability of Jailbreaking Attacks on LLMs via Removing Superfluous Constraints
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Jailbreaking attacks can effectively induce unsafe behaviors in Large Language Models (LLMs); however, the transferability of these attacks across different models remains limited. This study aims to understand and enhance the transferability of gradient-based jailbreaking methods, which are among the standard approaches for attacking white-box models. Through a detailed analysis of the optimization process, we introduce a novel conceptual framework to elucidate transferability and identify superfluous constraints-specifically, the response pattern constraint and the token tail constraint-as significant barriers to improved transferability. Removing these unnecessary constraints substantially enhances the transferability and controllability of gradient-based attacks. Evaluated on Llama-3-8B-Instruct as the source model, our method increases the overall Transfer Attack Success Rate (T-ASR) across a set of target models with varying safety levels from 18.4% to 50.3%, while also improving the stability and controllability of jailbreak behaviors on both source and target models.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 19 of its 40 references that are in the map. First posted on arXiv 25 Feb 2025.
Builds on
19 of 40 references.
Closest ancestors · 9
Same direction, newest first
- 2024Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities24 Oct
- 2024AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulation11 Oct
- 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMs11 Apr
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks2 Apr
- 2023Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization15 Nov
- 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulation6 Nov
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks5 Oct
- 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts19 Sep
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 10
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Qwen Technical Reportcited by 3,344
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 656
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
- 2024AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policiescited by 74
- 2023Ethicist: Targeted Training Data Extraction Through Loss Smoothed Soft Prompting and Calibrated Confidence Estimationcited by 36
Built on by
Citing papers per year: 2025: 5; 2026: 6.
11 papers.
- 2025FORCE: Transferable Visual Jailbreaking Attacks via Feature Over-Reliance CorrEctioncited by 11
- 2025Jailbreak Distillation: Renewable Safety Benchmarkingcited by 5
- 2025When Smiley Turns Hostile: Interpreting How Emojis Trigger LLMs' Toxicitycited by 2
- 2025SoK: A Comprehensive Security Analysis of Jailbreak Resilience in GPT and DeepSeek Modelscited by 1
- 2025One Leak Away: How Pretrained Model Exposure Amplifies Jailbreak Risks in Finetuned LLMscited by 1
- 2026Safety Beyond the Interface: Detecting Harm via Latent States in Large Language Modelscited by 1
- 2026Break the Brake, Not the Wheel: Untargeted Jailbreak via Entropy Maximizationcited by 0
- 2026Babel: Jailbreaking Safety Attention via Obfuscation Distribution Optimized Samplingcited by 0
- 2026A Single Suffix to Break Them All: Basin-Aware Jailbreaks for Merged Model Familiescited by 0
- 2026TACS: Trajectory-Aware Candidate Selection for LLM Jailbreak Suffix Optimizationcited by 0
- 2026Breadth Beats Depth: Improving GCG-Based Jailbreak Optimization with Breadth-Oriented Suffix Searchcited by 0
- 2026Safety Beyond the Interface: Detecting Harm via Latent States in Large Language Models16 Sep 2026
- 2026Breadth Beats Depth: Improving GCG-Based Jailbreak Optimization with Breadth-Oriented Suffix Search2 Sep 2026
- 2026TACS: Trajectory-Aware Candidate Selection for LLM Jailbreak Suffix Optimization30 Aug 2026
- 2026A Single Suffix to Break Them All: Basin-Aware Jailbreaks for Merged Model Families27 Aug 2026
- 2026Babel: Jailbreaking Safety Attention via Obfuscation Distribution Optimized Sampling18 May 2026
- 2026Break the Brake, Not the Wheel: Untargeted Jailbreak via Entropy Maximization11 May 2026
- 2025One Leak Away: How Pretrained Model Exposure Amplifies Jailbreak Risks in Finetuned LLMs14 Dec 2025
- 2025FORCE: Transferable Visual Jailbreaking Attacks via Feature Over-Reliance CorrEction25 Sep 2025
- 2025When Smiley Turns Hostile: Interpreting How Emojis Trigger LLMs' Toxicity14 Sep 2025
- 2025SoK: A Comprehensive Security Analysis of Jailbreak Resilience in GPT and DeepSeek Models23 Jun 2025
- 2025Jailbreak Distillation: Renewable Safety Benchmarking28 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025Rewrite to Jailbreak: Discover Learnable and Transferable Implicit Harmfulness Instruction
- 2025Breaking the Ceiling: Exploring the Potential of Jailbreak Attacks through Expanding Strategy Space
- 2024A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Models
- 2024Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs
- 2024JailPO: A Novel Black-box Jailbreak Framework via Preference Optimization against Aligned LLMs
- 2026Systematic Scaling Analysis of Jailbreak Attacks in Large Language Models
- 2026Re-Triggering Safeguards within LLMs for Jailbreak Detection
- 2024Harnessing Task Overload for Scalable Jailbreak Attacks on Large Language Models