Safety Reconstructed: Generative Modeling via Masked Diffusion Builds Strong Safety Guardrails
On the map: Diffusion models → Discrete and text diffusion also fits: Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Guard models are the last line of defense between a language model and a harmful output, yet their training objective is surprisingly narrow. Existing guards learn to predict a single verdict token from a conversational context, concentrating supervision on a single target. The consequences are structural: models latch onto shortcut features, are overconfident, and remain sensitive to where safety evidence appears in the sequence rather than its role in the full context. We propose a different framing. Rather than predicting a label from text, our LLaDA-Guard asks which label better explains the text: scoring the prompt or response under each label hypothesis and classifying based on their difference. This shifts supervision to every token in the moderated region, forcing the model to account for full content rather than its most discriminative fragments. We instantiate this idea with a masked diffusion language model, fine-tuning LLaDA-8B-Instruct with a class-conditional reconstruction objective using LoRA and requiring no architectural changes beyond the base model. LLaDA-Guard leads on average rank against discriminative baselines trained on stronger backbones across seven held-out safety benchmarks, while exhibiting substantially better confidence calibration (ECE 0.0875 vs. 0.1384 for Qwen3Guard), less over-defense on benign prompts with unsafe-looking cues, and less prompt leakage when moderating responses. Its generative nature further enables token-level risk localization as a natural byproduct, yielding a pipeline for rewriting unsafe prompts into safe equivalents without additional training and achieving a 60.7% average conversion-to-safe rate.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 44 of its 53 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
44 of 53 references.
Closest ancestors · 4
Same direction, newest first
- 2025Large Language Diffusion Models14 Feb
- 2024Simple and Effective Masked Diffusion Language Models11 Jun
- 2024Simplified and Generalized Masked Diffusion for Discrete Data6 Jun
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution25 Oct
Other references · 40
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
- 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 630
28 more
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
- 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 477
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 460
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 457
- 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 449
- 2022A Continuous Time Framework for Discrete Denoising Modelscited by 437
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 301
- 2023ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI Conversationcited by 224
- 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 224
- 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 222
- 2023An Overview of Catastrophic AI Riskscited by 214
- 2024Foundational Challenges in Assuring Alignment and Safety of Large Language Modelscited by 193
- 2021Noisy Channel Language Model Prompting for Few-Shot Text Classificationcited by 163
- 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
- 2023Text-to-Image Diffusion Models are Zero-Shot Classifierscited by 140
- 2025Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrailscited by 122
- 2023Attention Sorting Combats Recency Bias In Long Context Language Modelscited by 89
- 2023Robust Classification via a Single Diffusion Modelcited by 79
- 2025LLM Agents for Education: Advances and Applicationscited by 59
- 2025PolyGuard: A Multilingual Safety Moderation Tool for 17 Languagescited by 57
- 2024Automatic Pseudo-Harmful Prompt Generation for Evaluating False Refusals in Large Language Modelscited by 35
- 2017Generative and Discriminative Text Classification with Recurrent Neural Networkscited by 30
- 2025CultureGuard: Towards Culturally-Aware Dataset and Guard Model for Multilingual Safety Applicationscited by 24
- 2024On Calibration of LLM-based Guard Models for Reliable Content Moderationcited by 21
- 2024STAND-Guard: A Small Task-Adaptive Content Moderation Modelcited by 11
- 2025Generative Classifiers Avoid Shortcut Solutionscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Unsafe Detection: Counterfactually Anchored Evidence Attribution for Multi-Turn LLM Safety Failures
- 2025ThinkGuard: Deliberative Slow Thinking Leads to Cautious Guardrails
- 2026Robust and Efficient Guardrails with Latent Reasoning
- 2026SentGuard: Sentence-Level Streaming Guardrails for Large Language Models
- 2026YuFeng-XGuard: A Reasoning-Centric, Interpretable, and Flexible Guardrail Model for Large Language Models
- 2026CourtGuard: A Model-Agnostic Framework for Zero-Shot Policy Adaptation in LLM Safety
- 2026Safe responses matter: Output-aware safety guardrail mitigate over-refusal in MLLMs
- 2026Beyond Safe Data: Pretraining-Stage Alignment with Regular Safety Reflection