mlsanityData to 14 Oct 2026

Jailbreaking Commercial Black-Box LLMs with Explicitly Harmful Prompts

arXiv 2508.10390 ↗First posted 14 Aug 2025cs.CL cs.CRcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Existing black-box jailbreak attacks achieve certain success on non-reasoning models but degrade significantly on recent SOTA reasoning models. To improve attack ability, inspired by adversarial aggregation strategies, we integrate multiple jailbreak tricks into a single developer template. Especially, we apply Adversarial Context Alignment to purge semantic inconsistencies and use NTP (a type of harmful prompt) -based few-shot examples to guide malicious outputs, lastly forming DH-CoT attack with a fake chain of thought. In experiments, we further observe that existing red-teaming datasets include samples unsuitable for evaluating attack gains, such as BPs, NHPs, and NTPs. Such data hinders accurate evaluation of true attack effect lifts. To address this, we introduce MDH, a Malicious content Detection framework integrating LLM-based annotation with Human assistance, with which we clean data and build RTA dataset suite. Experiments show that MDH reliably filters low-quality samples and that DH-CoT effectively jailbreaks models including GPT-5 and Claude-4, notably outperforming SOTA methods like H-CoT and TAP.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 19 of its 26 references that are in the map. First posted on arXiv 14 Aug 2025.

Builds on

19 of 26 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025H-CoT: Hijacking the Chain-of-Thought Safety Reasoning Mechanism to Jailbreak Large Reasoning Models, Including OpenAI o1/o3, DeepSeek-R1, and Gemini 2.0 Flash Thinking18 Feb

Other references · 18

  1. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  2. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  3. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
  4. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  5. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
  6. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  7. 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 498
  8. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
  9. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Ciphercited by 423
  10. 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
  11. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
  12. 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 328
6 more
  1. 2020Dynamic Divide-and-Conquer Adversarial Training for Robust Semantic Segmentationcited by 38
  2. 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 23
  3. 2019Adversarial CAPTCHAscited by 16
  4. 2021Conditional Temporal Variational AutoEncoder for Action Video Predictioncited by 9
  5. 2022General Adversarial Defense Against Black-box Attacks via Pixel Level and Feature Level Distribution Alignmentscited by 4
  6. 2024GADT: Enhancing Transferable Adversarial Attacks through Gradient-guided Adversarial Data Transformationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Art of the Jailbreak: Formulating Jailbreak Attacks for LLM Security Beyond Binary Scoring
  2. 2025Rewrite to Jailbreak: Discover Learnable and Transferable Implicit Harmfulness Instruction
  3. 2024Jailbreak Attacks and Defenses Against Large Language Models: A Survey
  4. 2025Anyone Can Jailbreak: Prompt-Based Attacks on LLMs and T2Is
  5. 2025Reason2Attack: Jailbreaking Text-to-Image Models via LLM Reasoning
  6. 2025Efficient and Stealthy Jailbreak Attacks via Adversarial Prompt Distillation from LLMs to SLMs
  7. 2026SoK: Robustness in Large Language Models against Jailbreak Attacks
  8. 2025Exploring Jailbreak Attacks on LLMs through Intent Concealment and Diversion