Jailbreaking Commercial Black-Box LLMs with Explicitly Harmful Prompts
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Existing black-box jailbreak attacks achieve certain success on non-reasoning models but degrade significantly on recent SOTA reasoning models. To improve attack ability, inspired by adversarial aggregation strategies, we integrate multiple jailbreak tricks into a single developer template. Especially, we apply Adversarial Context Alignment to purge semantic inconsistencies and use NTP (a type of harmful prompt) -based few-shot examples to guide malicious outputs, lastly forming DH-CoT attack with a fake chain of thought. In experiments, we further observe that existing red-teaming datasets include samples unsuitable for evaluating attack gains, such as BPs, NHPs, and NTPs. Such data hinders accurate evaluation of true attack effect lifts. To address this, we introduce MDH, a Malicious content Detection framework integrating LLM-based annotation with Human assistance, with which we clean data and build RTA dataset suite. Experiments show that MDH reliably filters low-quality samples and that DH-CoT effectively jailbreaks models including GPT-5 and Claude-4, notably outperforming SOTA methods like H-CoT and TAP.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 26 references that are in the map. First posted on arXiv 14 Aug 2025.
Builds on
19 of 26 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 498
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
- 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Ciphercited by 423
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
- 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
- 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 328
6 more
- 2020Dynamic Divide-and-Conquer Adversarial Training for Robust Semantic Segmentationcited by 38
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 23
- 2019Adversarial CAPTCHAscited by 16
- 2021Conditional Temporal Variational AutoEncoder for Action Video Predictioncited by 9
- 2022General Adversarial Defense Against Black-box Attacks via Pixel Level and Feature Level Distribution Alignmentscited by 4
- 2024GADT: Enhancing Transferable Adversarial Attacks through Gradient-guided Adversarial Data Transformationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026The Art of the Jailbreak: Formulating Jailbreak Attacks for LLM Security Beyond Binary Scoring
- 2025Rewrite to Jailbreak: Discover Learnable and Transferable Implicit Harmfulness Instruction
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Survey
- 2025Anyone Can Jailbreak: Prompt-Based Attacks on LLMs and T2Is
- 2025Reason2Attack: Jailbreaking Text-to-Image Models via LLM Reasoning
- 2025Efficient and Stealthy Jailbreak Attacks via Adversarial Prompt Distillation from LLMs to SLMs
- 2026SoK: Robustness in Large Language Models against Jailbreak Attacks
- 2025Exploring Jailbreak Attacks on LLMs through Intent Concealment and Diversion