Rethinking White-Box Watermarks on Deep Learning Models under Neural Structural Obfuscation
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Copyright protection for deep neural networks (DNNs) is an urgent need for AI corporations. To trace illegally distributed model copies, DNN watermarking is an emerging technique for embedding and verifying secret identity messages in the prediction behaviors or the model internals. Sacrificing less functionality and involving more knowledge about the target DNN, the latter branch called textitwhite-box DNN watermarking is believed to be accurate, credible and secure against most known watermark removal attacks, with emerging research efforts in both the academy and the industry. In this paper, we present the first systematic study on how the mainstream white-box DNN watermarks are commonly vulnerable to neural structural obfuscation with textitdummy neurons, a group of neurons which can be added to a target model but leave the model behavior invariant. Devising a comprehensive framework to automatically generate and inject dummy neurons with high stealthiness, our novel attack intensively modifies the architecture of the target model to inhibit the success of watermark verification. With extensive evaluation, our work for the first time shows that nine published watermarking schemes require amendments to their verification procedures.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 36 of its 68 references that are in the map. First posted on arXiv 17 Mar 2023.
Builds on
36 of 68 references.
Closest ancestors · 1
Same direction, newest first
Other references · 35
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2016Pruning Filters for Efficient ConvNetscited by 1,129
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
23 more
- 2018Spectral Signatures in Backdoor Attackscited by 457
- 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 429
- 2019Dreaming to Distill: Data-free Knowledge Transfer via DeepInversioncited by 419
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 285
- 2017Embedding Watermarks into Deep Neural Networkscited by 227
- 2019High Accuracy and High Fidelity Extraction of Neural Networkscited by 208
- 2020Entangled Watermarks as a Defense against Model Extractioncited by 144
- 2015Path-SGD: Path-Normalized Optimization in Deep Neural Networkscited by 117
- 2018Stealing Hyperparameters in Machine Learningcited by 115
- 2019DAWN: Dynamic Adversarial Watermarking of Neural Networkscited by 94
- 2018Cache Telepathy: Leveraging Shared Resource Attacks to Learn DNN Architecturescited by 56
- 2021Protecting Intellectual Property of Generative Adversarial Networks from Ambiguity Attackcited by 45
- 2016Compression of Neural Machine Translation Models via Pruningcited by 43
- 2020Passport-aware Normalization for Deep Model Protectioncited by 42
- 2020Hermes Attack: Steal DNN Models with Lossless Inference Accuracycited by 41
- 2019REFIT: A Unified Watermark Removal Framework For Deep Learning Systems With Limited Datacited by 40
- 2020Neural Network Laundering: Removing Black-Box Backdoor Watermarks from Deep Neural Networkscited by 24
- 2020Protect, Show, Attend and Tell: Empowering Image Captioning Models with Ownership Protectioncited by 18
- 2020Fine-tuning Is Not Enough: A Simple yet Effective Watermark Removal Attack for DNN Modelscited by 18
- 2021You are caught stealing my winning lottery ticket! Making a lottery ticket claim its ownershipcited by 16
- 2019Effectiveness of Distillation Attack and Countermeasure on Neural Network Watermarkingcited by 11
- 2017On Secure and Usable Program Obfuscation: A Surveycited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 6; 2025: 8; 2026: 4.
20 papers.
Sort:
By area:
- 2024Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature Attributioncited by 35
- 2025Model Provenance Testing for Large Language Modelscited by 15
- 2023Functional Invariants to Watermark Large Transformerscited by 14
- 2024SLIP: Securing LLMs IP Using Weights Decompositioncited by 13
- 2024WET: Overcoming Paraphrasing Vulnerabilities in Embeddings-as-a-Service with Linear Transformation Watermarkscited by 5
- 2024DeepEclipse: How to Break White-Box DNN-Watermarking Schemescited by 4
- 2025Watermarking Graph Neural Networks via Explanations for Ownership Protectioncited by 3
- 2023Neural Dehydration: Effective Erasure of Black-box Watermarks from DNNs with Limited Datacited by 2
- 2024Revisiting Black-Box Model Ownership Verification through Information Theorycited by 2
- 2025Hashed Watermark as a Filter: Defeating Forging and Overwriting Attacks in Weight-based Neural Network Watermarkingcited by 2
- 2025AGATE: Stealthy Black-box Watermarking for Multimodal Model Copyright Protectioncited by 1
- 2025WGLE:Backdoor-free and Multi-bit Black-box Watermarking for Graph Neural Networkscited by 1
8 more
- 2024Your Semantic-Independent Watermark is Fragile: A Semantic Perturbation Attack against EaaS Watermarkcited by 0
- 2025PoLO: Proof-of-Learning and Proof-of-Ownership at Once with Chained Watermarkingcited by 0
- 2025Invariant-based Robust Weights Watermark for Large Language Modelscited by 0
- 2025Server-Enforced Watermarking in U-Shaped Split Federated Learningcited by 0
- 2026Functional Subspace Watermarking for Large Language Modelscited by 0
- 2026DIPBox: A Multi-scale Testing Framework for Tracking Dataset Regenerationcited by 0
- 2026MeMark: Membrane-Space Watermarking for Spiking Neural Networkscited by 0
- 2026Artificial intelligence and biosecurity: capabilities, threat pathways, and defense-in-depth governancecited by 0
- 2026Artificial intelligence and biosecurity: capabilities, threat pathways, and defense-in-depth governance14 Sep 2026
- 2026MeMark: Membrane-Space Watermarking for Spiking Neural Networks26 Aug 2026
- 2026DIPBox: A Multi-scale Testing Framework for Tracking Dataset Regeneration19 Jun 2026
- 2026Functional Subspace Watermarking for Large Language Models19 Mar 2026
- 2025Server-Enforced Watermarking in U-Shaped Split Federated Learning18 Nov 2025
- 2025Hashed Watermark as a Filter: Defeating Forging and Overwriting Attacks in Weight-based Neural Network Watermarking15 Jul 2025
- 2025Invariant-based Robust Weights Watermark for Large Language Models11 Jul 2025
- 2025WGLE:Backdoor-free and Multi-bit Black-box Watermarking for Graph Neural Networks10 Jun 2025
- 2025PoLO: Proof-of-Learning and Proof-of-Ownership at Once with Chained Watermarking18 May 2025
- 2025AGATE: Stealthy Black-box Watermarking for Multimodal Model Copyright Protection28 Apr 2025
- 2025Model Provenance Testing for Large Language Models2 Feb 2025
- 2025Watermarking Graph Neural Networks via Explanations for Ownership Protection9 Jan 2025
8 more
- 2024Your Semantic-Independent Watermark is Fragile: A Semantic Perturbation Attack against EaaS Watermark14 Nov 2024
- 2024Revisiting Black-Box Model Ownership Verification through Information Theory10 Sep 2024
- 2024WET: Overcoming Paraphrasing Vulnerabilities in Embeddings-as-a-Service with Linear Transformation Watermarks29 Aug 2024
- 2024SLIP: Securing LLMs IP Using Weights Decomposition15 Jul 2024
- 2024Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature Attribution8 May 2024
- 2024DeepEclipse: How to Break White-Box DNN-Watermarking Schemes6 Mar 2024
- 2023Functional Invariants to Watermark Large Transformers17 Oct 2023
- 2023Neural Dehydration: Effective Erasure of Black-box Watermarks from DNNs with Limited Data7 Sep 2023
- 2024Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature Attributioncited by 35
- 2024Revisiting Black-Box Model Ownership Verification through Information Theorycited by 2
- 2025AGATE: Stealthy Black-box Watermarking for Multimodal Model Copyright Protectioncited by 1
- 2025Invariant-based Robust Weights Watermark for Large Language Modelscited by 0
- 2026Functional Subspace Watermarking for Large Language Modelscited by 0
- 2026Functional Subspace Watermarking for Large Language Models19 Mar 2026
- 2025Invariant-based Robust Weights Watermark for Large Language Models11 Jul 2025
- 2025AGATE: Stealthy Black-box Watermarking for Multimodal Model Copyright Protection28 Apr 2025
- 2024Revisiting Black-Box Model Ownership Verification through Information Theory10 Sep 2024
- 2024Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature Attribution8 May 2024
- 2025Model Provenance Testing for Large Language Modelscited by 15
- 2023Functional Invariants to Watermark Large Transformerscited by 14
- 2024SLIP: Securing LLMs IP Using Weights Decompositioncited by 13
- 2024WET: Overcoming Paraphrasing Vulnerabilities in Embeddings-as-a-Service with Linear Transformation Watermarkscited by 5
- 2024DeepEclipse: How to Break White-Box DNN-Watermarking Schemescited by 4
- 2025Watermarking Graph Neural Networks via Explanations for Ownership Protectioncited by 3
- 2023Neural Dehydration: Effective Erasure of Black-box Watermarks from DNNs with Limited Datacited by 2
- 2025Hashed Watermark as a Filter: Defeating Forging and Overwriting Attacks in Weight-based Neural Network Watermarkingcited by 2
- 2025WGLE:Backdoor-free and Multi-bit Black-box Watermarking for Graph Neural Networkscited by 1
- 2024Your Semantic-Independent Watermark is Fragile: A Semantic Perturbation Attack against EaaS Watermarkcited by 0
- 2025PoLO: Proof-of-Learning and Proof-of-Ownership at Once with Chained Watermarkingcited by 0
- 2025Server-Enforced Watermarking in U-Shaped Split Federated Learningcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Artificial intelligence and biosecurity: capabilities, threat pathways, and defense-in-depth governance14 Sep 2026
- 2026MeMark: Membrane-Space Watermarking for Spiking Neural Networks26 Aug 2026
- 2026DIPBox: A Multi-scale Testing Framework for Tracking Dataset Regeneration19 Jun 2026
- 2025Server-Enforced Watermarking in U-Shaped Split Federated Learning18 Nov 2025
- 2025Hashed Watermark as a Filter: Defeating Forging and Overwriting Attacks in Weight-based Neural Network Watermarking15 Jul 2025
- 2025WGLE:Backdoor-free and Multi-bit Black-box Watermarking for Graph Neural Networks10 Jun 2025
- 2025PoLO: Proof-of-Learning and Proof-of-Ownership at Once with Chained Watermarking18 May 2025
- 2025Model Provenance Testing for Large Language Models2 Feb 2025
- 2025Watermarking Graph Neural Networks via Explanations for Ownership Protection9 Jan 2025
- 2024Your Semantic-Independent Watermark is Fragile: A Semantic Perturbation Attack against EaaS Watermark14 Nov 2024
- 2024WET: Overcoming Paraphrasing Vulnerabilities in Embeddings-as-a-Service with Linear Transformation Watermarks29 Aug 2024
- 2024SLIP: Securing LLMs IP Using Weights Decomposition15 Jul 2024
12 newest of 15 All 15 (JSON)