Watermarking Discrete Diffusion Language Models
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Watermarking has emerged as a promising technique to track AI-generated content and differentiate it from authentic human creations. While prior work extensively studies watermarking for autoregressive large language models (LLMs) and image diffusion models, it remains comparatively underexplored for discrete diffusion language models (DDLMs), which are becoming popular due to their high inference throughput. In this paper, we introduce one of the first watermarking methods for DDLMs. Our approach applies a distribution-preserving Gumbel-max sampling trick at every diffusion step and seeds the randomness by sequence position to enable reliable detection. We empirically demonstrate reliable detectability on LLaDA, a state-of-the-art DDLM. We also analytically prove that the watermark is distortion-free, with a false detection probability that decays exponentially in the sequence length. A key practical advantage is that our method realizes desired watermarking properties with no expensive hyperparameter tuning, making it straightforward to deploy and scale across models and benchmarks.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 36 of its 54 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
36 of 54 references.
Closest ancestors · 4
Same direction, newest first
- 2025Watermarking Diffusion Language Models29 Sep
- 2024ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimization6 Nov
- 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
- 2023A Recipe for Watermarking Diffusion Models17 Mar
Other references · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2025Large Language Diffusion Modelscited by 872
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 712
- 2023A Watermark for Large Language Modelscited by 667
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
- 2023Robust Distortion-free Watermarks for Language Modelscited by 279
20 more
- 2025Mercury: Ultra-Fast Language Models Based on Diffusioncited by 225
- 2023Undetectable Watermarks for Language Modelscited by 208
- 2022SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Controlcited by 191
- 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 160
- 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 148
- 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
- 2023The Science of Detecting LLM-Generated Textscited by 126
- 2025Diffusion LLMs Can Do Faster-Than-AR Inference via Discrete Diffusion Forcingcited by 111
- 2025LaViDa: A Large Diffusion Language Model for Multimodal Understandingcited by 81
- 2024Watermark Stealing in Large Language Modelscited by 79
- 2023Publicly-Detectable Watermarking for Language Modelscited by 69
- 2024A Statistical Framework of Watermarks for Large Language Models: Pivot, Detection Efficiency and Optimal Rulescited by 53
- 2024WaterMax: breaking the LLM watermark detectability-robustness-quality trade-offcited by 48
- 2021Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generationcited by 40
- 2024Robust Detection of Watermarks for Large Language Models Under Human Editscited by 29
- 2023WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Modelscited by 27
- 2024Theoretically Grounded Framework for LLM Watermarking: A Distribution-Adaptive Approachcited by 17
- 2020Limits of Detecting Text Generated by Large-Scale Language Modelscited by 15
- 2024Deception and Manipulation in Generative AIcited by 8
- 2025Watermarking across Modalities for Content Tracing and Generative AIcited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026dgMARK: Decoding-Guided Watermarking for Diffusion Language Modelscited by 1
- 2026Chainwash: Multi-Step Rewriting Attacks on Diffusion Language Model Watermarkscited by 1
- 2026Global Sketch-Based Watermarking for Diffusion Language Modelscited by 1
- 2026SAC-Copula: Quality-Preserving Watermarking for Diffusion Language Models via Smooth Correlated Gumbel Fieldscited by 1
- 2026TANGO: Watermarking Masked Diffusion Language Models in Token Pairscited by 0
- 2026TANGO: Watermarking Masked Diffusion Language Models in Token Pairs28 Sep 2026
- 2026SAC-Copula: Quality-Preserving Watermarking for Diffusion Language Models via Smooth Correlated Gumbel Fields21 Aug 2026
- 2026Global Sketch-Based Watermarking for Diffusion Language Models3 Jun 2026
- 2026Chainwash: Multi-Step Rewriting Attacks on Diffusion Language Model Watermarks6 May 2026
- 2026dgMARK: Decoding-Guided Watermarking for Diffusion Language Models30 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026LR-DWM: Efficient Watermarking for Diffusion Language Models
- 2026Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Models
- 2026WMVLM: Evaluating Diffusion Model Image Watermarking via Vision-Language Models
- 2026DenMark: Robust Semantic Watermarking for Diffusion Language Models
- 2025T2SMark: Balancing Robustness and Diversity in Noise-as-Watermark for Diffusion Models
- 2024Inevitable Trade-off between Watermark Strength and Speculative Sampling Efficiency for Language Models
- 2026Watermarkable Multi-Draft Speculative Sampling via Poisson Processes
- 2025MaXsive: High-Capacity and Robust Training-Free Generative Image Watermarking in Diffusion Models