mlsanityData to 14 Oct 2026

Faster-GCG: Efficient Discrete Optimization Jailbreak Attacks against Aligned Large Language Models

arXiv 2410.15362 ↗First posted 20 Oct 2024cs.LG cs.AI cs.CLcited by 25

On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks

also in 1 more
Abstract (arXiv)

Aligned Large Language Models (LLMs) have attracted significant attention for their safety, particularly in the context of jailbreak attacks that attempt to bypass guardrails via adversarial prompts. Among existing approaches, the Greedy Coordinate Gradient (GCG) attack pioneered automated jailbreaks through discrete token optimization; however, its low sample efficiency limits practical applicability. In particular, GCG requires approximately 256K evaluations per harmful behavior to achieve a satisfactory jailbreak success rate, due to the inherent difficulty of the underlying discrete optimization problem. In this work, we identify three key factors that limit the sample efficiency of GCG: inaccurate gradient-based estimation, inefficient uniform sampling, and repeated evaluation of previously explored suffixes. To address these issues, we propose Faster-GCG, a streamlined variant of GCG that incorporates distance-based regularization for improved estimation, temperature-controlled sampling for more effective exploration, and a visited-suffix marking mechanism to avoid redundant evaluations. Faster-GCG reduced the required evaluations to 32K, achieving up to an 8× improvement in sampling efficiency and a 7× reduction in wall-clock time compared to GCG. Under this reduced budget, Faster-GCG attained an average jailbreak success rate of 78.1% across five aligned LLMs, and achieved 88.7% against Qwen3.5-4B, outperforming state-of-the-art white-box jailbreak methods.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 33 of its 50 references that are in the map. First posted on arXiv 20 Oct 2024.

Builds on

33 of 50 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations10 Oct
  2. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct
  3. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
  4. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Models1 Sep
  5. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher12 Aug
  6. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul

Other references · 27

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  6. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
  7. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  8. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  9. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  10. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
  11. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
  12. 2020On Adaptive Attacks to Adversarial Example Defensescited by 555
15 more
  1. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
  2. 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 469
  3. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
  4. 2024A StrongREJECT for Empty Jailbreakscited by 385
  5. 2023Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attackscited by 278
  6. 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMscited by 199
  7. 2023MMA-Diffusion: MultiModal Attack on Diffusion Modelscited by 194
  8. 2023MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbotscited by 183
  9. 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMscited by 172
  10. 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attackscited by 156
  11. 2024Improved Techniques for Optimization-Based Jailbreaking on Large Language Modelscited by 110
  12. 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 89
  13. 2024FlipAttack: Jailbreak LLMs via Flippingcited by 80
  14. 2024Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Samplingcited by 37
  15. 2024ADBM: Adversarial diffusion bridge model for reliable adversarial purificationcited by 24

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 14; 2026: 9.

25 papers.

Sort:

By area:

  1. 2026Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMscited by 17
  2. 2024GASP: Efficient Black-Box Generation of Adversarial Suffixes for Jailbreaking LLMscited by 12
  3. 2026HoneyTrap: Deceiving Large Language Model Attackers to Honeypot Traps with Resilient Multi-Agent Defensecited by 8
  4. 2025Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyondcited by 6
  5. 2025Mask-GCG: Are All Tokens in Adversarial Suffixes Necessary for Jailbreak Attacks?cited by 6
  6. 2025NonTextual Target Attackcited by 3
  7. 2025BadLingual: A Novel Lingual-Backdoor Attack against Large Language Modelscited by 2
  8. 2025Phonetic Perturbations Reveal Tokenizer-Rooted Safety Gaps in LLMscited by 2
  9. 2025Checkpoint-GCG: Auditing and Attacking Fine-Tuning-Based Prompt Injection Defensescited by 2
  10. 2025Safety-Aligned Weights Are Not Enough: Refusal-Teacher-Guided Finetuning Enhances Safety and Downstream Performance under Harmful Finetuning Attackscited by 2
  11. 2025ConceptGuard: Neuro-Symbolic Safety Guardrails via Sparse Interpretable Jailbreak Conceptscited by 2
  12. 2025Breaking Minds, Breaking Systems: Jailbreaking Large Language Models via Human-like Psychological Manipulationcited by 2
13 more
  1. 2026CoopGuard: Stateful Cooperative Agents Safeguarding LLMs Against Evolving Multi-Round Attackscited by 2
  2. 2026SlotGCG: Exploiting the Positional Vulnerability in LLMs for Jailbreak Attackscited by 2
  3. 2026COPA: Continual Preference Optimization for Adaptive Prompt Injection Defensecited by 2
  4. 2024DeMem: Privacy-Enhanced Robust Adversarial Learning via De-Memorizationcited by 1
  5. 2025Benign-to-Toxic Jailbreaking: Inducing Harmful Responses from Harmless Promptscited by 1
  6. 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systemscited by 1
  7. 2025Eyes-on-Me: Scalable RAG Poisoning through Transferable Attention-Steering Attractorscited by 1
  8. 2026Jailbreaking LLMs Without Gradients or Priors: Effective and Transferable Attackscited by 1
  9. 2026Sirens' Whisper: Inaudible Near-Ultrasonic Jailbreaks of Speech-Driven LLMscited by 1
  10. 2026Diffusion LLMs as Targets and Adversaries: Mechanistic Safety Exploitscited by 1
  11. 2025Between a Rock and a Hard Place: The Tension Between Ethical Reasoning and Safety Alignment in LLMscited by 0
  12. 2025TASO: Jailbreak LLMs via Alternative Template and Suffix Optimizationcited by 0
  13. 2026GPO-V: Jailbreak Diffusion Vision Language Model by Global Probability Optimizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Exploiting the Index Gradients for Optimization-Based Jailbreaking on Large Language Models
  2. 2026Breadth Beats Depth: Improving GCG-Based Jailbreak Optimization with Breadth-Oriented Suffix Search
  3. 2024Boosting Jailbreak Attack with Momentum
  4. 2024AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulation
  5. 2026Beyond Suffixes: Token Position in GCG Adversarial Attacks on Large Language Models
  6. 2026TAO-Attack: Toward Advanced Optimization-Based Jailbreak Attacks for Large Language Models
  7. 2025The Resurgence of GCG Adversarial Attacks on Large Language Models
  8. 2024Boosting Jailbreak Transferability for Large Language Models