Reliable Model Watermarking: Defending Against Theft without Compromising on Evasion
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
With the rise of Machine Learning as a Service (MLaaS) platforms,safeguarding the intellectual property of deep learning models is becoming paramount. Among various protective measures, trigger set watermarking has emerged as a flexible and effective strategy for preventing unauthorized model distribution. However, this paper identifies an inherent flaw in the current paradigm of trigger set watermarking: evasion adversaries can readily exploit the shortcuts created by models memorizing watermark samples that deviate from the main task distribution, significantly impairing their generalization in adversarial settings. To counteract this, we leverage diffusion models to synthesize unrestricted adversarial examples as trigger sets. By learning the model to accurately recognize them, unique watermark behaviors are promoted through knowledge injection rather than error memorization, thus avoiding exploitable shortcuts. Furthermore, we uncover that the resistance of current trigger set watermarking against removal attacks primarily relies on significantly damaging the decision boundaries during embedding, intertwining unremovability with adverse impacts. By optimizing the knowledge transfer properties of protected models, our approach conveys watermark behaviors to extraction surrogates without aggressively decision boundary perturbation. Experimental results on CIFAR-10/100 and Imagenette datasets demonstrate the effectiveness of our method, showing not only improved robustness against evasion adversaries but also superior resistance to watermark removal attacks compared to state-of-the-art solutions.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 51 of its 88 references that are in the map. First posted on arXiv 21 Apr 2024.
Builds on
51 of 88 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2017Random Erasing Data Augmentationcited by 1,235
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
38 more
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 950
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
- 2017Snapshot Ensembles: Train 1, get M for freecited by 349
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 312
- 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 290
- 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 285
- 2017Embedding Watermarks into Deep Neural Networkscited by 227
- 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 225
- 2021Does Knowledge Distillation Really Work?cited by 187
- 2020Self-Distillation Amplifies Regularization in Hilbert Spacecited by 171
- 2019Thieves on Sesame Street! Model Extraction of BERT-based APIscited by 136
- 2018Constructing Unrestricted Adversarial Examples with Generative Modelscited by 135
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 124
- 2020Data-Free Model Extractioncited by 121
- 2019DAWN: Dynamic Adversarial Watermarking of Neural Networkscited by 94
- 2019Deep Neural Network Fingerprinting by Conferrable Adversarial Examplescited by 90
- 2018Universal Adversarial Trainingcited by 85
- 2022I Know What You Trained Last Summer: A Survey on Stealing Machine Learning Models and Defencescited by 75
- 2021SoK: How Robust is Image Classification Deep Neural Network Watermarking? (Extended Version)cited by 67
- 2021Learning Student-Friendly Teacher Networks for Knowledge Distillationcited by 58
- 2023AdvDiff: Generating Unrestricted Adversarial Examples using Diffusion Modelscited by 46
- 2021Consistency Regularization for Adversarial Robustnesscited by 42
- 2022Certified Neural Network Watermarks with Randomized Smoothingcited by 39
- 2020TrojanZoo: Towards Unified, Holistic, and Practical Evaluation of Neural Backdoorscited by 30
- 2023Out-of-Domain Robustness via Targeted Augmentationscited by 24
- 2020Fine-tuning Is Not Enough: A Simple yet Effective Watermark Removal Attack for DNN Modelscited by 18
- 2023On student-teacher deviations in distillation: does it pay to disobey?cited by 16
- 2023GKD: A General Knowledge Distillation Framework for Large-scale Pre-trained Language Modelcited by 15
- 2023Improving Compositional Generalization Using Iterated Learning and Simplicial Embeddingscited by 15
- 2022Free Fine-tuning: A Plug-and-Play Watermarking Scheme for Deep Neural Networkscited by 14
- 2022Conflicting Interactions Among Protection Mechanisms for Machine Learning Modelscited by 12
- 2022A law of adversarial risk, interpolation, and label noisecited by 8
- 2023Tailoring Instructions to Student's Learning Levels Boosts Knowledge Distillationcited by 8
- 2022Toward Student-Oriented Teacher Network Training For Knowledge Distillationcited by 7
- 2022Cracking White-box DNN Watermarks via Invariant Neuron Transformscited by 5
- 2023Safe and Robust Watermark Injection with a Single OoD Imagecited by 3
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 2.
9 papers.
- 2025RGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answeringcited by 5
- 2026AgentMark: Utility-Preserving Behavioral Watermarking for Agentscited by 5
- 2024Efficient and Effective Model Extractioncited by 4
- 2024Revisiting Black-Box Model Ownership Verification through Information Theorycited by 2
- 2025Holmes: Towards Effective and Harmless Model Ownership Verification to Personalized Large Vision Models via Decoupling Common Featurescited by 2
- 2025Evading Data Provenance in Deep Neural Networkscited by 2
- 2025PATFinger: Prompt-Adapted Transferable Fingerprinting against Unauthorized Multimodal Dataset Usagecited by 1
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspectivecited by 1
- 2025Class-feature Watermark: A Resilient Black-box Watermark Against Model Extraction Attackscited by 0
- 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspective25 Mar 2026
- 2026AgentMark: Utility-Preserving Behavioral Watermarking for Agents5 Jan 2026
- 2025Class-feature Watermark: A Resilient Black-box Watermark Against Model Extraction Attacks11 Nov 2025
- 2025Evading Data Provenance in Deep Neural Networks1 Aug 2025
- 2025Holmes: Towards Effective and Harmless Model Ownership Verification to Personalized Large Vision Models via Decoupling Common Features24 Jun 2025
- 2025PATFinger: Prompt-Adapted Transferable Fingerprinting against Unauthorized Multimodal Dataset Usage15 Apr 2025
- 2025RGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answering19 Feb 2025
- 2024Efficient and Effective Model Extraction21 Sep 2024
- 2024Revisiting Black-Box Model Ownership Verification through Information Theory10 Sep 2024
Similar, not cited
Close in wording, no citation either way
- 2025When There Is No Decoder: Removing Watermarks from Stable Diffusion Models in a No-box Setting
- 2024Exploiting Watermark-Based Defense Mechanisms in Text-to-Image Diffusion Models for Unauthorized Data Usage
- 2025Secure and Efficient Watermarking for Latent Diffusion Models in Model Distribution Scenarios
- 2025Invisible Backdoor Triggers in Image Editing Model via Deep Watermarking
- 2024Embedding Watermarks in Diffusion Process for Model Intellectual Property Protection
- 2024Agentic Copyright Watermarking against Adversarial Evidence Forgery with Purification-Agnostic Curriculum Proxy Learning
- 2024RoboSignature: Robust Signature and Watermarking on Network Attacks
- 2026SemBind: Binding Diffusion Watermarks to Semantics Against Black-Box Forgery Attacks