mlsanityData to 7 Oct 2026

Step-Wise Refusal Dynamics in Autoregressive and Diffusion Language Models

arXiv 2602.02600 ↗First posted 1 Feb 2026cs.LG cs.AIcited by 1

On the map: Diffusion models → Discrete and text diffusion

also in 2 more
Abstract (arXiv)

Diffusion language models (DLMs) have recently emerged as a competitive alternative to autoregressive (AR) models, offering parallel decoding, competitive generation quality, and initial evidence of improved jailbreak robustness. Despite this progress, the role of sampling mechanisms in shaping refusal behavior remains poorly understood. To address this gap, we present a comprehensive study of step-wise refusal dynamics. We show that diffusion remasking can promote recovery from harmful intermediate generations, provide evidence that this behavior is tied to the sampling mechanism, and demonstrate that switching from AR to diffusion sampling improves jailbreak robustness, including under fixed model weights. To capture generation dynamics not observable at the text level, we propose the Step-Wise Refusal Internal Dynamics (SRI) signal. Consistent with our text-level findings, SRI shows that recovery fails primarily under AR sampling, with these failures often appearing anomalous relative to harmless generations in the SRI space. Based on this observation, we show that SRI enables a simple jailbreak detector that does not modify inference and generalizes to unseen attacks by training only on benign SRI signals. Our evaluation shows that this detector matches or outperforms existing jailbreak detection baselines while adding negligible overhead.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 43 of its 55 references that are in the map. First posted on arXiv 1 Feb 2026.

Builds on

43 of 55 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100B10 Dec
  2. 2025SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation7 Oct
  3. 2025A2D: Any-Order, Any-Step Safety Alignment for Diffusion Language Models27 Sep
  4. 2025Dream 7B: Diffusion Large Language Models21 Aug
  5. 2025Discrete Diffusion in Large Language and Multimodal Models: A Survey16 Jun
  6. 2025Large Language Diffusion Models14 Feb
  7. 2022Latent Diffusion for Language Generation19 Dec
  8. 2022DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models28 Nov

Other references · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2017On Calibration of Modern Neural Networkscited by 4,860
  7. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  8. 2023A Survey of Large Language Modelscited by 2,537
  9. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  10. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  11. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,326
  12. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
23 more
  1. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  2. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  3. 2022Diffusion Models in Vision: A Surveycited by 1,008
  4. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  5. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  6. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
  7. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  8. 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
  9. 2023Detecting Language Model Attacks with Perplexitycited by 411
  10. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
  11. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
  12. 2023LLM Self Defense: By Self Examination, LLMs Know They Are Being Trickedcited by 226
  13. 2025Qwen2.5-1M Technical Reportcited by 158
  14. 2025The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independencecited by 104
  15. 2024Safeguarding Large Language Models: A Surveycited by 73
  16. 2024FlipAttack: Jailbreak LLMs via Flippingcited by 73
  17. 2024Large Language Model Safety: A Holistic Surveycited by 56
  18. 2025The Devil behind the mask: An emergent safety vulnerability of Diffusion LLMscited by 32
  19. 2025Jailbreaking Large Language Diffusion Models: Revealing Hidden Safety Flaws in Diffusion-Based Text Generationcited by 24
  20. 2025A Survey of Attacks on Large Language Modelscited by 13
  21. 2025DiffuGuard: How Intrinsic Safety is Lost and Found in Diffusion Large Language Modelscited by 11
  22. 2025Jailbreak Attack Initializations as Extractors of Compliance Directionscited by 10
  23. 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safetycited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Why Jailbreaks Succeed in Diffusion Language Models: An Energy Landscape Analysis
  2. 2025Toward Safer Diffusion Language Models: Discovery and Mitigation of Priming Vulnerability
  3. 2026Breaking Refusal in the First Half: A Mechanistic Study of the Prefill Jailbreak
  4. 2024Gradient Cuff: Detecting Jailbreak Attacks on Large Language Models by Exploring Refusal Loss Landscapes
  5. 2024DiffusionAttacker: Diffusion-Driven Prompt Manipulation for LLM Jailbreak
  6. 2026Efficient Refusal Ablation in LLM through Optimal Transport
  7. 2026GPO-V: Jailbreak Diffusion Vision Language Model by Global Probability Optimization
  8. 2026LESS Is More: Mutual-Stability Sampling for Diffusion Language Models