DMark: Order-Agnostic Watermarking for Diffusion Large Language Models
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Diffusion large language models (dLLMs) offer faster generation than autoregressive models while maintaining comparable quality, but existing watermarking methods fail on them due to their non-sequential decoding. Unlike autoregressive models that generate tokens left-to-right, dLLMs can finalize tokens in arbitrary order, breaking the causal design underlying traditional watermarks. We present DMark, the first watermarking framework designed specifically for dLLMs. DMark introduces three complementary strategies to restore watermark detectability: predictive watermarking uses model-predicted tokens when actual context is unavailable; bidirectional watermarking exploits both forward and backward dependencies unique to diffusion decoding; and predictive-bidirectional watermarking combines both approaches to maximize detection strength. Experiments across multiple dLLMs show that DMark achieves 92.0-99.5% detection rates at 1% false positive rate while maintaining text quality, compared to only 49.6-71.2% for naive adaptations of existing methods. DMark also demonstrates robustness against text manipulations, establishing that effective watermarking is feasible for non-autoregressive language models.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 27 of its 32 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
27 of 32 references.
Closest ancestors · 10
Same direction, newest first
- 2024De-mark: Watermark Removal in Large Language Models17 Oct
- 2024MarkLLM: An Open-Source Toolkit for LLM Watermarking16 May
- 2024Watermark Stealing in Large Language Models29 Feb
- 2024Provably Robust Multi-bit Watermarking for AI-generated Text30 Jan
- 2024Adaptive Text Watermark for Large Language Models25 Jan
- 2023A Survey of Text Watermarking in the Era of Large Language Models13 Dec
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun
- 2023Undetectable Watermarks for Language Models25 May
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
- 2023A Watermark for Large Language Models24 Jan
Other references · 17
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2025Large Language Diffusion Modelscited by 872
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
- 2019ELI5: Long Form Question Answeringcited by 567
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 273
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
5 more
- 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 173
- 2023A Reparameterized Discrete Diffusion Model for Text Generationcited by 152
- 2025Discrete Diffusion in Large Language and Multimodal Models: A Surveycited by 61
- 2023Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuningcited by 39
- 2025TESS 2: A Large-Scale Generalist Diffusion Language Modelcited by 30
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026dgMARK: Decoding-Guided Watermarking for Diffusion Language Modelscited by 1
- 2026SAMark: A Self-Anchored Text Watermarking with Paragraph-Level Paraphrase Robustnesscited by 1
- 2026AliMark: Enhancing Robustness of Sentence-Level Watermarking Against Text Paraphrasingcited by 0
- 2026TANGO: Watermarking Masked Diffusion Language Models in Token Pairscited by 0
- 2026TANGO: Watermarking Masked Diffusion Language Models in Token Pairs28 Sep 2026
- 2026AliMark: Enhancing Robustness of Sentence-Level Watermarking Against Text Paraphrasing28 May 2026
- 2026SAMark: A Self-Anchored Text Watermarking with Paragraph-Level Paraphrase Robustness25 May 2026
- 2026dgMARK: Decoding-Guided Watermarking for Diffusion Language Models30 Jan 2026