TAO-Attack: Toward Advanced Optimization-Based Jailbreak Attacks for Large Language Models
On the map: LLM alignment / RLHF / preference optimisation → Safety alignment and jailbreak attacks
also in 1 more
Abstract (arXiv)
Large language models (LLMs) have achieved remarkable success across diverse applications but remain vulnerable to jailbreak attacks, where attackers craft prompts that bypass safety alignment and elicit unsafe responses. Among existing approaches, optimization-based attacks have shown strong effectiveness, yet current methods often suffer from frequent refusals, pseudo-harmful outputs, and inefficient token-level updates. In this work, we propose TAO-Attack, a new optimization-based jailbreak method. TAO-Attack employs a two-stage loss function: the first stage suppresses refusals to ensure the model continues harmful prefixes, while the second stage penalizes pseudo-harmful outputs and encourages the model toward more harmful completions. In addition, we design a direction-priority token optimization (DPTO) strategy that improves efficiency by aligning candidates with the gradient direction before considering update magnitude. Extensive experiments on multiple LLMs demonstrate that TAO-Attack consistently outperforms state-of-the-art methods, achieving higher attack success rates and even reaching 100% in certain scenarios.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Safety alignment and jailbreak attacks, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 29 of its 37 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
29 of 37 references.
Closest ancestors · 4
Same direction, newest first
- 2024SCANS: Mitigating the Exaggerated Safety for LLMs via Safety-Conscious Activation Steering21 Aug
- 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep10 Jun
- 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models3 Oct
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 25
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023Mistral 7Bcited by 3,065
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automaticallycited by 619
- 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 478
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 457
- 2023Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attackscited by 268
- 2023MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Modelscited by 255
13 more
- 2024AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMscited by 160
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 156
- 2024Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attackscited by 150
- 2024AdvPrompter: Fast Adaptive Adversarial Prompting for LLMscited by 146
- 2024Improved Techniques for Optimization-Based Jailbreaking on Large Language Modelscited by 98
- 2024Fight Back Against Jailbreaking via Prompt Adversarial Tuningcited by 63
- 2024Language Models Resist Alignment: Evidence From Data Compressioncited by 50
- 2024Boosting Jailbreak Attack with Momentumcited by 38
- 2024Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Samplingcited by 33
- 2023Query-Efficient Black-Box Red Teaming via Bayesian Optimizationcited by 31
- 2024All in How You Ask for It: Simple Black-Box Method for Jailbreak Attackscited by 30
- 2024HQA-Attack: Toward High Quality Black-Box Hard-Label Adversarial Attack on Textcited by 16
- 2025Confidence Elicitation: A New Attack Vector for Large Language Modelscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025CCJA: Context-Coherent Jailbreak Attack for Aligned Large Language Models
- 2024JailPO: A Novel Black-box Jailbreak Framework via Preference Optimization against Aligned LLMs
- 2024AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulation
- 2024Defensive Prompt Patch: A Robust and Interpretable Defense of LLMs against Jailbreak Attacks
- 2025Jailbreaking in the Haystack
- 2024Defending Large Language Models Against Jailbreak Attacks via Layer-specific Editing
- 2025Prefill-level Jailbreak: A Black-Box Risk Analysis of Large Language Models
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Survey