mlsanityData to 7 Oct 2026

Watermarking Discrete Diffusion Language Models

arXiv 2511.02083 ↗First posted 3 Nov 2025cs.CR cs.AI cs.CYcited by 5

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 1 more
Abstract (arXiv)

Watermarking has emerged as a promising technique to track AI-generated content and differentiate it from authentic human creations. While prior work extensively studies watermarking for autoregressive large language models (LLMs) and image diffusion models, it remains comparatively underexplored for discrete diffusion language models (DDLMs), which are becoming popular due to their high inference throughput. In this paper, we introduce one of the first watermarking methods for DDLMs. Our approach applies a distribution-preserving Gumbel-max sampling trick at every diffusion step and seeds the randomness by sequence position to enable reliable detection. We empirically demonstrate reliable detectability on LLaDA, a state-of-the-art DDLM. We also analytically prove that the watermark is distortion-free, with a false detection probability that decays exponentially in the sequence length. A key practical advantage is that our method realizes desired watermarking properties with no expensive hyperparameter tuning, making it straightforward to deploy and scale across models and benchmarks.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 36 of its 54 references that are in the map. First posted on arXiv 3 Nov 2025.

Builds on

36 of 54 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Watermarking Diffusion Language Models29 Sep
  2. 2024ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimization6 Nov
  3. 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
  4. 2023A Recipe for Watermarking Diffusion Models17 Mar

Other references · 32

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  6. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  7. 2025Large Language Diffusion Modelscited by 872
  8. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 712
  9. 2023A Watermark for Large Language Modelscited by 667
  10. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
  11. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
  12. 2023Robust Distortion-free Watermarks for Language Modelscited by 279
20 more
  1. 2025Mercury: Ultra-Fast Language Models Based on Diffusioncited by 225
  2. 2023Undetectable Watermarks for Language Modelscited by 208
  3. 2022SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Controlcited by 191
  4. 2020Automatic Detection of Machine Generated Text: A Critical Surveycited by 160
  5. 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 148
  6. 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
  7. 2023The Science of Detecting LLM-Generated Textscited by 126
  8. 2025Diffusion LLMs Can Do Faster-Than-AR Inference via Discrete Diffusion Forcingcited by 111
  9. 2025LaViDa: A Large Diffusion Language Model for Multimodal Understandingcited by 81
  10. 2024Watermark Stealing in Large Language Modelscited by 79
  11. 2023Publicly-Detectable Watermarking for Language Modelscited by 69
  12. 2024A Statistical Framework of Watermarks for Large Language Models: Pivot, Detection Efficiency and Optimal Rulescited by 53
  13. 2024WaterMax: breaking the LLM watermark detectability-robustness-quality trade-offcited by 48
  14. 2021Global Context with Discrete Diffusion in Vector Quantised Modelling for Image Generationcited by 40
  15. 2024Robust Detection of Watermarks for Large Language Models Under Human Editscited by 29
  16. 2023WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Modelscited by 27
  17. 2024Theoretically Grounded Framework for LLM Watermarking: A Distribution-Adaptive Approachcited by 17
  18. 2020Limits of Detecting Text Generated by Large-Scale Language Modelscited by 15
  19. 2024Deception and Manipulation in Generative AIcited by 8
  20. 2025Watermarking across Modalities for Content Tracing and Generative AIcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026LR-DWM: Efficient Watermarking for Diffusion Language Models
  2. 2026Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Models
  3. 2026WMVLM: Evaluating Diffusion Model Image Watermarking via Vision-Language Models
  4. 2026DenMark: Robust Semantic Watermarking for Diffusion Language Models
  5. 2025T2SMark: Balancing Robustness and Diversity in Noise-as-Watermark for Diffusion Models
  6. 2024Inevitable Trade-off between Watermark Strength and Speculative Sampling Efficiency for Language Models
  7. 2026Watermarkable Multi-Draft Speculative Sampling via Poisson Processes
  8. 2025MaXsive: High-Capacity and Robust Training-Free Generative Image Watermarking in Diffusion Models