mlsanityData to 14 Oct 2026

Guiding not Forcing: Enhancing the Transferability of Jailbreaking Attacks on LLMs via Removing Superfluous Constraints

arXiv 2503.01865 ↗First posted 25 Feb 2025cs.LG cs.AI cs.CRcited by 11

On the map: LLM safety and security → Jailbreaking

Abstract (arXiv)

Jailbreaking attacks can effectively induce unsafe behaviors in Large Language Models (LLMs); however, the transferability of these attacks across different models remains limited. This study aims to understand and enhance the transferability of gradient-based jailbreaking methods, which are among the standard approaches for attacking white-box models. Through a detailed analysis of the optimization process, we introduce a novel conceptual framework to elucidate transferability and identify superfluous constraints-specifically, the response pattern constraint and the token tail constraint-as significant barriers to improved transferability. Removing these unnecessary constraints substantially enhances the transferability and controllability of gradient-based attacks. Evaluated on Llama-3-8B-Instruct as the source model, our method increases the overall Transfer Attack Success Rate (T-ASR) across a set of target models with varying safety levels from 18.4% to 50.3%, while also improving the stability and controllability of jailbreak behaviors on both source and target models.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 19 of its 40 references that are in the map. First posted on arXiv 25 Feb 2025.

Builds on

19 of 40 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities24 Oct
  2. 2024AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulation11 Oct
  3. 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMs11 Apr
  4. 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks2 Apr
  5. 2023Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization15 Nov
  6. 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulation6 Nov
  7. 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attacks5 Oct
  8. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts19 Sep
  9. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 10

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2023Qwen Technical Reportcited by 3,344
  5. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  6. 2024Yi: Open Foundation Models by 01.AIcited by 719
  7. 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 656
  8. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  9. 2024AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policiescited by 74
  10. 2023Ethicist: Targeted Training Data Extraction Through Loss Smoothed Soft Prompting and Calibrated Confidence Estimationcited by 36

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 6.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Rewrite to Jailbreak: Discover Learnable and Transferable Implicit Harmfulness Instruction
  2. 2025Breaking the Ceiling: Exploring the Potential of Jailbreak Attacks through Expanding Strategy Space
  3. 2024A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Models
  4. 2024Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs
  5. 2024JailPO: A Novel Black-box Jailbreak Framework via Preference Optimization against Aligned LLMs
  6. 2026Systematic Scaling Analysis of Jailbreak Attacks in Large Language Models
  7. 2026Re-Triggering Safeguards within LLMs for Jailbreak Detection
  8. 2024Harnessing Task Overload for Scalable Jailbreak Attacks on Large Language Models