mlsanityData to 14 Oct 2026

DenMark: Robust Semantic Watermarking for Diffusion Language Models

arXiv 2609.14257 ↗First posted 13 Sep 2026cs.CLcited by 1

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 1 more
Abstract (arXiv)

Semantic text watermarks encode signals in meaning rather than surface token choices, offering robustness to paraphrasing and other semantic-preserving edits. Existing semantic watermarking methods are primarily designed for autoregressive language models (ARLMs), where completed candidate units can be generated and scored before generation proceeds. This paradigm does not naturally extend to diffusion language models (DLMs), where semantic units remain incomplete during intermediate denoising steps and tokens may be updated in flexible orders. We propose DenMark, a semantic watermarking framework that injects key-dependent signals directly into the DLM denoising process. DenMark partitions the output into fixed token regions and uses temporary rollouts as semantic lookahead: conditional completions estimate the eventual semantics of an incomplete region, enabling DenMark to select local updates with higher estimated semantic watermark scores. Repeating this procedure across denoising steps progressively accumulates watermark evidence in the final output. For detection, DenMark uses calibrated scanning over candidate unit sizes to remain robust to boundary shifts introduced by semantic attacks. Across four DLMs, three datasets, and four semantic attacks, DenMark gives the strongest overall robustness and achieves the best TPR at each reported operating point in 46 of the 48 backbone-dataset-attack combinations. Overall, DenMark provides an effective semantic watermark for DLMs. Code is available at https://github.com/TianhaoMa5/DenoMark.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 40 of its 51 references that are in the map. First posted on arXiv 13 Sep 2026.

Builds on

40 of 51 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026LR-DWM: Efficient Watermarking for Diffusion Language Models18 Jan
  2. 2025Watermarking Diffusion Language Models29 Sep

Other references · 38

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  7. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  8. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  9. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  10. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  11. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  12. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
26 more
  1. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  2. 2021Ethical and social risks of harm from Language Modelscited by 966
  3. 2025Large Language Diffusion Modelscited by 912
  4. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  5. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 748
  6. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
  7. 2023A Watermark for Large Language Modelscited by 725
  8. 2019ELI5: Long Form Question Answeringcited by 575
  9. 2025Dream 7B: Diffusion Large Language Modelscited by 544
  10. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
  11. 2023Robust Distortion-free Watermarks for Language Modelscited by 320
  12. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
  13. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 274
  14. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 166
  15. 2023A Robust Semantics-based Watermark for Large Language Model against Paraphrasingcited by 82
  16. 2024k-SemStamp: A Clustering-Based Semantic Watermark for Detection of Machine-Generated Textcited by 51
  17. 2023WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Modelscited by 32
  18. 2024Permute-and-Flip: An optimally stable and watermarkable decoder for LLMscited by 22
  19. 2025PMark: Towards Robust and Distortion-free Semantic-level Watermarking with Channel Constraintscited by 16
  20. 2025SimMark: A Robust Sentence-Level Similarity-Based Watermarking Algorithm for Large Language Modelscited by 15
  21. 2024A Watermark for Order-Agnostic Language Modelscited by 14
  22. 2025Defending LLM Watermarking Against Spoofing Attacks with Contrastive Representation Learningcited by 10
  23. 2025On the Empirical Power of Goodness-of-Fit Tests in Watermark Detectioncited by 5
  24. 2026Decomposing the Basic Abilities of Large Language Models: Mitigating Cross-Task Interference in Multi-Task Instruct-Tuningcited by 5
  25. 2025Creative4U: MLLMs-based Advertising Creative Image Selector with Comparative Reasoningcited by 2
  26. 2026Every Bit, Everywhere, All at Once: A Binomial Multibit LLM Watermarkcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025DMark: Order-Agnostic Watermarking for Diffusion Large Language Models
  2. 2026dgMARK: Decoding-Guided Watermarking for Diffusion Language Models
  3. 2026WMVLM: Evaluating Diffusion Model Image Watermarking via Vision-Language Models
  4. 2026Global Sketch-Based Watermarking for Diffusion Language Models
  5. 2026Beyond Semantic Narrowing: Robust and Efficient LLM Watermarking with Hamming Neighborhoods
  6. 2025Watermarking Discrete Diffusion Language Models
  7. 2023Three Bricks to Consolidate Watermarks for Large Language Models
  8. 2024PostMark: A Robust Blackbox Watermark for Large Language Models