Backdooring Masked Diffusion Language Models
On the map: Diffusion models → Discrete and text diffusion
also in 1 more
Abstract (arXiv)
Masked diffusion language models (MDLMs) are emerging as a compelling new paradigm for text generation, but their training-time security remains largely unexplored. Existing backdoor attacks on Gaussian diffusion models or autoregressive language models do not directly apply to MDLMs because MDLMs rely on discrete state corruption and iterative denoising rather than continuous noising or left-to-right prediction. In this work, we present the first systematic study of training-time backdoor attacks on MDLMs. We propose SHADOWMASK, a backdoor attack that modifies the MDLM forward corruption process by replacing the standard all-mask terminal distribution with a trigger-mask mixture prior. This creates a dedicated denoising pathway from trigger-corrupted states to attacker-specified targets while preserving clean denoising behavior. We further provide a principled mathematical formulation by defining the backdoored forward process, deriving the reverse-time posterior, and obtaining the continuous-time training objective. Evaluations on DiT-based MDLM and LLaDA-8B-Instruct across WikiText-103, OpenWebText, and Alpaca show that SHADOWMASK achieves near-100% attack success, substantially outperforms standard data poisoning, largely preserves clean utility, remains effective under full-model and parameter-efficient fine-tuning, and is robust against representative defenses.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 38 of its 45 references that are in the map. First posted on arXiv 19 May 2026.
Builds on
38 of 45 references.
Closest ancestors · 13
Same direction, newest first
- 2025Every Step Counts: Decoding Trajectories as Authorship Fingerprints of dLLMs2 Oct
- 2025A2D: Any-Order, Any-Step Safety Alignment for Diffusion Language Models27 Sep
- 2025Dream 7B: Diffusion Large Language Models21 Aug
- 2025The Diffusion Duality12 Jun
- 2025Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmasking30 May
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models12 Mar
- 2025Large Language Diffusion Models14 Feb
- 2024Simple and Effective Masked Diffusion Language Models11 Jun
- 2024Simplified and Generalized Masked Diffusion for Discrete Data6 Jun
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data6 Jun
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution25 Oct
- 2022DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models28 Nov
1 more
Other references · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2016Pointer Sentinel Mixture Modelscited by 2,992
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2023Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injectioncited by 143
- 2020Just How Toxic is Data Poisoning? A Unified Benchmark for Backdoor and Data Poisoning Attackscited by 109
- 2021Backdoor Attacks on Pre-trained Models by Layerwise Weight Poisoningcited by 103
- 2022How to Backdoor Diffusion Models?cited by 102
- 2023Text-to-Image Diffusion Models can be Easily Backdoored through Multimodal Data Poisoningcited by 91
- 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targetscited by 88
- 2023VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion Modelscited by 68
- 2023Composite Backdoor Attacks Against Large Language Modelscited by 63
13 more
- 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Modelscited by 44
- 2025The Devil behind the mask: An emergent safety vulnerability of Diffusion LLMscited by 32
- 2023Elijah: Eliminating Backdoors Injected in Diffusion Models via Distribution Shiftcited by 31
- 2025Jailbreaking Large Language Diffusion Models: Revealing Hidden Safety Flaws in Diffusion-Based Text Generationcited by 24
- 2023Less is More: Selective Layer Finetuning with SubTuningcited by 13
- 2024A Study of Backdoors in Instruction Fine-tuned Language Modelscited by 11
- 2025Where to Start Alignment? Diffusion Large Language Model May Demand a Distinct Positioncited by 11
- 2025DiffuGuard: How Intrinsic Safety is Lost and Found in Diffusion Large Language Modelscited by 11
- 2025Toward Safer Diffusion Language Models: Discovery and Mitigation of Priming Vulnerabilitycited by 10
- 2025Persistent Backdoor Attacks under Continual Fine-Tuning of LLMscited by 7
- 2026Membership Inference Attacks Against Fine-tuned Diffusion Language Modelscited by 5
- 2026Self-Purification Mitigates Backdoors in Multimodal Diffusion Language Modelscited by 2
- 2025Aligning Diffusion Language Models via Unpaired Preference Optimizationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Plan for Speed: Dilated Scheduling for Masked Diffusion Language Models
- 2026BadDLM: Backdooring Diffusion Language Models with Diverse Targets
- 2026Machine Unlearning for Masked Diffusion Language Models
- 2026Membership Inference Attacks on Discrete Diffusion Language Models
- 2026Not All Denoising Steps Are Equal: Model Scheduling for Faster Masked Diffusion Language Models
- 2026Re-evaluating Confidence Remasking in Masked Diffusion Language Models
- 2023A Cheaper and Better Diffusion Language Model with Soft-Masked Noise
- 2025Activation Steering for Masked Diffusion Language Models