mlsanityData to 14 Oct 2026

Adaptive Steering and Remasking for Safe Generation in Diffusion Language Models

arXiv 2605.13043 ↗First posted 13 May 2026cs.CLcited by 1

On the map: Diffusion models → Discrete and text diffusion

also in 1 more
Abstract (arXiv)

Diffusion Language Models(DLMs) provide a promising alternative to autoregressive language models through iterative denoising and bidirectional generation. However, their iterative generation process introduces distinct safety vulnerabilities because harmful content can emerge at arbitrary positions and persist across subsequent denoising steps. Existing defenses rely on fixed interventions or aggressive remasking, which limits adaptive control over denoising trajectories and can degrade generation quality. We propose an inference-time defense framework that combines adaptive safety steering with safety-aware remasking. Our method uses a gating direction to continuously adjust steering strength from the current denoising state and applies a steering direction to masked positions to guide subsequent predictions toward safer trajectories. Our method further employs a lightweight response detector after the first generation block to identify unsafe trajectories at an early stage. The detector triggers targeted remasking over generated content and part of the conditioning prompt, and the model regenerates the selected positions under adaptive safety steering. This design combines continuous trajectory control with explicit correction of unsafe content while requiring no modification of model parameters. Experiments on LLaDA and Dream demonstrate that our method improves robustness against diverse jailbreak attacks while preserving benign generation quality and general model capability. Our code is available at https://anonymous.4open.science/r/DLM_Steering-C32B/.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 35 of its 38 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

35 of 38 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025A2D: Any-Order, Any-Step Safety Alignment for Diffusion Language Models27 Sep
  2. 2025Dream 7B: Diffusion Large Language Models21 Aug
  3. 2025Remasking Discrete Diffusion Models with Inference-Time Scaling1 Mar
  4. 2025Large Language Diffusion Models14 Feb
  5. 2024Simple and Effective Masked Diffusion Language Models11 Jun
  6. 2022Continuous diffusion for categorical data28 Nov
  7. 2022DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models28 Nov
  8. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models17 Oct

Other references · 27

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  6. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  7. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  8. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  9. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  10. 2023Jailbreaking Black Box Large Language Models in Twenty Queriescited by 1,420
  11. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  12. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
15 more
  1. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  2. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
  3. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
  4. 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 505
  5. 2024A StrongREJECT for Empty Jailbreakscited by 385
  6. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
  7. 2024WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language Modelscited by 223
  8. 2024Lisa: Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning Attackcited by 92
  9. 2025The Devil behind the mask: An emergent safety vulnerability of Diffusion LLMscited by 34
  10. 2025DiffuGuard: How Intrinsic Safety is Lost and Found in Diffusion Large Language Modelscited by 12
  11. 2025Toward Safer Diffusion Language Models: Discovery and Mitigation of Priming Vulnerabilitycited by 10
  12. 2025Intrinsic Model Weaknesses: How Priming Attacks Unveil Vulnerabilities in Large Language Modelscited by 3
  13. 2025Assessing and Mitigating Data Memorization Risks in Fine-Tuned Large Language Modelscited by 3
  14. 2025GuardNet: Graph-Attention Filtering for Jailbreak Defense in Large Language Modelscited by 3
  15. 2026How Does the Thinking Step Influence Model Safety? An Entropy-based Safety Reminder for LRMscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Safety-Aware Denoiser for Text Diffusion Models
  2. 2026Re-Mask and Redirect: Exploiting Denoising Irreversibility in Diffusion Language Models
  3. 2026Remask, Don't Replace: Token-to-Mask Refinement in Diffusion Language Models
  4. 2026DLM-SWAI: Steering Diffusion Language Models Before They Unmask
  5. 2025Don't Settle Too Early: Self-Reflective Remasking for Diffusion Language Models
  6. 2026Adaptation to Intrinsic Dependence in Diffusion Language Models
  7. 2026Diffusion Language Models: An Experimental Analysis
  8. 2026Targeted Remasking: Replacing Token Editing with Token-to-Mask Refinement in Discrete Diffusion Language Models