mlsanityData to 14 Oct 2026

One Word at a Time: Incremental Completion Decomposition Breaks LLM Safety

arXiv 2604.25921 ↗First posted 1 Apr 2026cs.CL cs.CRcited by 1

On the map: LLM safety and security → Jailbreaking

Abstract (arXiv)

Large Language Models (LLMs) are trained to refuse harmful requests, yet they remain vulnerable to jailbreak attacks that exploit weaknesses in conversational safety mechanisms. We introduce Incremental Completion Decomposition ICD, a trajectory-based jailbreak strategy that elicits a sequence of single-word continuations related to a malicious request before eliciting the full response. In addition, we propose ICD variants that use model-generated or attacker-injected intermediate continuations, as well as final-response prefilling. We evaluate these variants across a broad set of open-weight model families, demonstrating superior Attack Success Rate (ASR) on AdvBench, JailbreakBench, and StrongREJECT compared to existing methods. In addition, we provide a theoretical account of why ICD is effective and present mechanistic evidence that successful attack trajectories suppress refusal-related representations and shift activations away from safety-aligned states.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 24 of its 37 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

24 of 37 references.

Closest ancestors · 16

Same direction, newest first

  1. 2024Multi-Turn Context Jailbreak Attack on Large Language Models From First Principles8 Aug
  2. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack2 Apr
  3. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models28 Mar
  4. 2024A StrongREJECT for Empty Jailbreaks15 Feb
  5. 2024Leveraging the Context through Multi-Round Interactions for Jailbreaking Attacks14 Feb
  6. 2024Weak-to-Strong Jailbreaking on Large Language Models30 Jan
  7. 2023Tree of Attacks: Jailbreaking Black-Box LLMs Automatically4 Dec
  8. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreaker6 Nov
  9. 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
  10. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts19 Sep
  11. 2023FuzzLLM: A Novel and Universal Fuzzing Framework for Proactively Discovering Jailbreak Vulnerabilities in Large Language Models11 Sep
  12. 2023Detecting Language Model Attacks with Perplexity27 Aug
4 more
  1. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher12 Aug
  2. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models7 Aug
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
  4. 2023MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbots16 Jul

Other references · 8

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2025Gemma 3 Technical Reportcited by 1,824
  4. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  5. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deepcited by 472
  6. 2024On Prompt-Driven Safeguarding for Large Language Modelscited by 116
  7. 2022Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLPcited by 102
  8. 2024Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLMcited by 77

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Incomplete Prompt Jailbreaks in Large Language Models
  2. 2026Defending Large Language Models Against Jailbreak Attacks via In-Decoding Safety-Awareness Probing
  3. 2024SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  4. 2025GRAF: Multi-turn Jailbreaking via Global Refinement and Active Fabrication
  5. 2025Automating Deception: Scalable Multi-Turn LLM Jailbreaks
  6. 2026CodeMimicry: Exploiting Safety Generalization Lag in Large Language Models via Structured Code Completion
  7. 2024SequentialBreak: Large Language Models Can be Fooled by Embedding Jailbreak Prompts into Sequential Prompt Chains
  8. 2025Pattern Enhanced Multi-Turn Jailbreaking: Exploiting Structural Vulnerabilities in Large Language Models