Faster-GCG: Efficient Discrete Optimization Jailbreak Attacks against Aligned Large Language Models
On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks
also in 1 more
Abstract (arXiv)
Aligned Large Language Models (LLMs) have attracted significant attention for their safety, particularly in the context of jailbreak attacks that attempt to bypass guardrails via adversarial prompts. Among existing approaches, the Greedy Coordinate Gradient (GCG) attack pioneered automated jailbreaks through discrete token optimization; however, its low sample efficiency limits practical applicability. In particular, GCG requires approximately 256K evaluations per harmful behavior to achieve a satisfactory jailbreak success rate, due to the inherent difficulty of the underlying discrete optimization problem. In this work, we identify three key factors that limit the sample efficiency of GCG: inaccurate gradient-based estimation, inefficient uniform sampling, and repeated evaluation of previously explored suffixes. To address these issues, we propose Faster-GCG, a streamlined variant of GCG that incorporates distance-based regularization for improved estimation, temperature-controlled sampling for more effective exploration, and a visited-suffix marking mechanism to avoid redundant evaluations. Faster-GCG reduced the required evaluations to 32K, achieving up to an 8× improvement in sampling efficiency and a 7× reduction in wall-clock time compared to GCG. Under this reduced budget, Faster-GCG attained an average jailbreak success rate of 78.1% across five aligned LLMs, and achieved 88.7% against Qwen3.5-4B, outperforming state-of-the-art white-box jailbreak methods.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 33 of its 50 references that are in the map. First posted on arXiv 20 Oct 2024.
Builds on
33 of 50 references.
Closest ancestors · 6
Same direction, newest first
- 2023Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations10 Oct
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Models1 Sep
- 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher12 Aug
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 27
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 672
- 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
- 2020On Adaptive Attacks to Adversarial Example Defensescited by 555
15 more
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
- 2023SmoothLLM: Defending Large Language Models Against Jailbreaking Attackscited by 469
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attackcited by 390
- 2024A StrongREJECT for Empty Jailbreakscited by 385
- 2023Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attackscited by 278
- 2024AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to Jailbreak LLMscited by 199
- 2023MMA-Diffusion: MultiModal Attack on Diffusion Modelscited by 194
- 2023MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbotscited by 183
- 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMscited by 172
- 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attackscited by 156
- 2024Improved Techniques for Optimization-Based Jailbreaking on Large Language Modelscited by 110
- 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 89
- 2024FlipAttack: Jailbreak LLMs via Flippingcited by 80
- 2024Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Samplingcited by 37
- 2024ADBM: Adversarial diffusion bridge model for reliable adversarial purificationcited by 24
Built on by
Citing papers per year: 2024: 2; 2025: 14; 2026: 9.
25 papers.
Sort:
By area:
- 2026Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMscited by 17
- 2024GASP: Efficient Black-Box Generation of Adversarial Suffixes for Jailbreaking LLMscited by 12
- 2026HoneyTrap: Deceiving Large Language Model Attackers to Honeypot Traps with Resilient Multi-Agent Defensecited by 8
- 2025Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyondcited by 6
- 2025Mask-GCG: Are All Tokens in Adversarial Suffixes Necessary for Jailbreak Attacks?cited by 6
- 2025NonTextual Target Attackcited by 3
- 2025BadLingual: A Novel Lingual-Backdoor Attack against Large Language Modelscited by 2
- 2025Phonetic Perturbations Reveal Tokenizer-Rooted Safety Gaps in LLMscited by 2
- 2025Checkpoint-GCG: Auditing and Attacking Fine-Tuning-Based Prompt Injection Defensescited by 2
- 2025Safety-Aligned Weights Are Not Enough: Refusal-Teacher-Guided Finetuning Enhances Safety and Downstream Performance under Harmful Finetuning Attackscited by 2
- 2025ConceptGuard: Neuro-Symbolic Safety Guardrails via Sparse Interpretable Jailbreak Conceptscited by 2
- 2025Breaking Minds, Breaking Systems: Jailbreaking Large Language Models via Human-like Psychological Manipulationcited by 2
13 more
- 2026CoopGuard: Stateful Cooperative Agents Safeguarding LLMs Against Evolving Multi-Round Attackscited by 2
- 2026SlotGCG: Exploiting the Positional Vulnerability in LLMs for Jailbreak Attackscited by 2
- 2026COPA: Continual Preference Optimization for Adaptive Prompt Injection Defensecited by 2
- 2024DeMem: Privacy-Enhanced Robust Adversarial Learning via De-Memorizationcited by 1
- 2025Benign-to-Toxic Jailbreaking: Inducing Harmful Responses from Harmless Promptscited by 1
- 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systemscited by 1
- 2025Eyes-on-Me: Scalable RAG Poisoning through Transferable Attention-Steering Attractorscited by 1
- 2026Jailbreaking LLMs Without Gradients or Priors: Effective and Transferable Attackscited by 1
- 2026Sirens' Whisper: Inaudible Near-Ultrasonic Jailbreaks of Speech-Driven LLMscited by 1
- 2026Diffusion LLMs as Targets and Adversaries: Mechanistic Safety Exploitscited by 1
- 2025Between a Rock and a Hard Place: The Tension Between Ethical Reasoning and Safety Alignment in LLMscited by 0
- 2025TASO: Jailbreak LLMs via Alternative Template and Suffix Optimizationcited by 0
- 2026GPO-V: Jailbreak Diffusion Vision Language Model by Global Probability Optimizationcited by 0
- 2026COPA: Continual Preference Optimization for Adaptive Prompt Injection Defense20 Aug 2026
- 2026Diffusion LLMs as Targets and Adversaries: Mechanistic Safety Exploits7 Aug 2026
- 2026SlotGCG: Exploiting the Positional Vulnerability in LLMs for Jailbreak Attacks4 Jun 2026
- 2026GPO-V: Jailbreak Diffusion Vision Language Model by Global Probability Optimization8 May 2026
- 2026CoopGuard: Stateful Cooperative Agents Safeguarding LLMs Against Evolving Multi-Round Attacks5 Apr 2026
- 2026Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMs25 Mar 2026
- 2026Sirens' Whisper: Inaudible Near-Ultrasonic Jailbreaks of Speech-Driven LLMs14 Mar 2026
- 2026HoneyTrap: Deceiving Large Language Model Attackers to Honeypot Traps with Resilient Multi-Agent Defense7 Jan 2026
- 2026Jailbreaking LLMs Without Gradients or Priors: Effective and Transferable Attacks6 Jan 2026
- 2025Breaking Minds, Breaking Systems: Jailbreaking Large Language Models via Human-like Psychological Manipulation20 Dec 2025
- 2025TASO: Jailbreak LLMs via Alternative Template and Suffix Optimization23 Nov 2025
- 2025NonTextual Target Attack3 Oct 2025
13 more
- 2025Eyes-on-Me: Scalable RAG Poisoning through Transferable Attention-Steering Attractors1 Oct 2025
- 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systems12 Sep 2025
- 2025Mask-GCG: Are All Tokens in Adversarial Suffixes Necessary for Jailbreak Attacks?8 Sep 2025
- 2025Between a Rock and a Hard Place: The Tension Between Ethical Reasoning and Safety Alignment in LLMs4 Sep 2025
- 2025ConceptGuard: Neuro-Symbolic Safety Guardrails via Sparse Interpretable Jailbreak Concepts22 Aug 2025
- 2025Safety-Aligned Weights Are Not Enough: Refusal-Teacher-Guided Finetuning Enhances Safety and Downstream Performance under Harmful Finetuning Attacks9 Jun 2025
- 2025Benign-to-Toxic Jailbreaking: Inducing Harmful Responses from Harmless Prompts26 May 2025
- 2025Checkpoint-GCG: Auditing and Attacking Fine-Tuning-Based Prompt Injection Defenses21 May 2025
- 2025Phonetic Perturbations Reveal Tokenizer-Rooted Safety Gaps in LLMs20 May 2025
- 2025BadLingual: A Novel Lingual-Backdoor Attack against Large Language Models6 May 2025
- 2025Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyond10 Mar 2025
- 2024DeMem: Privacy-Enhanced Robust Adversarial Learning via De-Memorization8 Dec 2024
- 2024GASP: Efficient Black-Box Generation of Adversarial Suffixes for Jailbreaking LLMs21 Nov 2024
- 2026Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMscited by 17
- 2024GASP: Efficient Black-Box Generation of Adversarial Suffixes for Jailbreaking LLMscited by 12
- 2025Mask-GCG: Are All Tokens in Adversarial Suffixes Necessary for Jailbreak Attacks?cited by 6
- 2025NonTextual Target Attackcited by 3
- 2025BadLingual: A Novel Lingual-Backdoor Attack against Large Language Modelscited by 2
- 2025Safety-Aligned Weights Are Not Enough: Refusal-Teacher-Guided Finetuning Enhances Safety and Downstream Performance under Harmful Finetuning Attackscited by 2
- 2025ConceptGuard: Neuro-Symbolic Safety Guardrails via Sparse Interpretable Jailbreak Conceptscited by 2
- 2025Breaking Minds, Breaking Systems: Jailbreaking Large Language Models via Human-like Psychological Manipulationcited by 2
- 2026SlotGCG: Exploiting the Positional Vulnerability in LLMs for Jailbreak Attackscited by 2
- 2026Jailbreaking LLMs Without Gradients or Priors: Effective and Transferable Attackscited by 1
- 2026Sirens' Whisper: Inaudible Near-Ultrasonic Jailbreaks of Speech-Driven LLMscited by 1
- 2026Diffusion LLMs as Targets and Adversaries: Mechanistic Safety Exploitscited by 1
12 most cited of 13 All 13 (JSON)
- 2026Diffusion LLMs as Targets and Adversaries: Mechanistic Safety Exploits7 Aug 2026
- 2026SlotGCG: Exploiting the Positional Vulnerability in LLMs for Jailbreak Attacks4 Jun 2026
- 2026Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMs25 Mar 2026
- 2026Sirens' Whisper: Inaudible Near-Ultrasonic Jailbreaks of Speech-Driven LLMs14 Mar 2026
- 2026Jailbreaking LLMs Without Gradients or Priors: Effective and Transferable Attacks6 Jan 2026
- 2025Breaking Minds, Breaking Systems: Jailbreaking Large Language Models via Human-like Psychological Manipulation20 Dec 2025
- 2025TASO: Jailbreak LLMs via Alternative Template and Suffix Optimization23 Nov 2025
- 2025NonTextual Target Attack3 Oct 2025
- 2025Mask-GCG: Are All Tokens in Adversarial Suffixes Necessary for Jailbreak Attacks?8 Sep 2025
- 2025ConceptGuard: Neuro-Symbolic Safety Guardrails via Sparse Interpretable Jailbreak Concepts22 Aug 2025
- 2025Safety-Aligned Weights Are Not Enough: Refusal-Teacher-Guided Finetuning Enhances Safety and Downstream Performance under Harmful Finetuning Attacks9 Jun 2025
- 2025BadLingual: A Novel Lingual-Backdoor Attack against Large Language Models6 May 2025
12 newest of 13 All 13 (JSON)
- 2026HoneyTrap: Deceiving Large Language Model Attackers to Honeypot Traps with Resilient Multi-Agent Defensecited by 8
- 2025Checkpoint-GCG: Auditing and Attacking Fine-Tuning-Based Prompt Injection Defensescited by 2
- 2026CoopGuard: Stateful Cooperative Agents Safeguarding LLMs Against Evolving Multi-Round Attackscited by 2
- 2026CoopGuard: Stateful Cooperative Agents Safeguarding LLMs Against Evolving Multi-Round Attacks5 Apr 2026
- 2026HoneyTrap: Deceiving Large Language Model Attackers to Honeypot Traps with Resilient Multi-Agent Defense7 Jan 2026
- 2025Checkpoint-GCG: Auditing and Attacking Fine-Tuning-Based Prompt Injection Defenses21 May 2025
- 2025Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyondcited by 6
- 2025Phonetic Perturbations Reveal Tokenizer-Rooted Safety Gaps in LLMscited by 2
- 2024DeMem: Privacy-Enhanced Robust Adversarial Learning via De-Memorizationcited by 1
- 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systemscited by 1
- 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systems12 Sep 2025
- 2025Phonetic Perturbations Reveal Tokenizer-Rooted Safety Gaps in LLMs20 May 2025
- 2025Trustworthy Machine Learning via Memorization and the Granular Long-Tail: A Survey on Interactions, Tradeoffs, and Beyond10 Mar 2025
- 2024DeMem: Privacy-Enhanced Robust Adversarial Learning via De-Memorization8 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2024Exploiting the Index Gradients for Optimization-Based Jailbreaking on Large Language Models
- 2026Breadth Beats Depth: Improving GCG-Based Jailbreak Optimization with Breadth-Oriented Suffix Search
- 2024Boosting Jailbreak Attack with Momentum
- 2024AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulation
- 2026Beyond Suffixes: Token Position in GCG Adversarial Attacks on Large Language Models
- 2026TAO-Attack: Toward Advanced Optimization-Based Jailbreak Attacks for Large Language Models
- 2025The Resurgence of GCG Adversarial Attacks on Large Language Models
- 2024Boosting Jailbreak Transferability for Large Language Models