T2S: A Rehearsal-Based Approach for Extraction-Resistant Model Watermarking
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Model watermarking safeguards AI model intellectual property by embedding distinctive knowledge that induces unique behavioral signatures. The primary technical challenge lies in ensuring watermark robustness against various post-processing attacks on the watermarked model. Model extraction attacks emerge as the most severe threat, where adversaries exploit prediction outputs to train surrogate models that illegally replicate the original model's functionality. In this work, we propose a rehearsal-based watermark embedding framework to enhance the robustness of model watermarks against model extraction attacks. By simulating the extraction process, our method leverages the loss of a textitsimulated stolen model on a trigger set as a training signal to fine-tune the watermark knowledge within the target model. This fine-tuning step encourages the watermark to be embedded in a way that boosts transferability, thereby increasing its chances of persisting and remaining detectable in stolen models. Comprehensive experiments conducted under diverse settings demonstrate that the proposed method significantly improves the robustness of model watermarks against both model extraction and subsequent watermark removal attacks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 25 of its 37 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
25 of 37 references.
Closest ancestors · 1
Same direction, newest first
Other references · 24
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2017To prune, or not to prune: exploring the efficacy of pruning for model compressioncited by 596
- 2016Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activationscited by 413
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 285
- 2017Embedding Watermarks into Deep Neural Networkscited by 227
- 2019High Accuracy and High Fidelity Extraction of Neural Networkscited by 208
- 2018PRADA: Protecting against DNN Model Stealing Attackscited by 159
- 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 149
12 more
- 2020Entangled Watermarks as a Defense against Model Extractioncited by 144
- 2020Data-Free Model Extractioncited by 121
- 2022Narcissus: A Practical Clean-Label Backdoor Attack with Limited Informationcited by 102
- 2020MAZE: Data-Free Model Stealing Attack Using Zeroth-Order Gradient Estimationcited by 99
- 2019Prediction Poisoning: Towards Defenses Against DNN Model Stealing Attackscited by 79
- 2021SoK: How Robust is Image Classification Deep Neural Network Watermarking? (Extended Version)cited by 67
- 2021BERT Learns to Teach: Knowledge Distillation with Meta Learningcited by 61
- 2022Towards Data-Free Model Stealing in a Hard Label Settingcited by 57
- 2019Stateful Detection of Black-Box Adversarial Attackscited by 55
- 2019Defending Against Model Stealing Attacks with Adaptive Misinformationcited by 55
- 2018Digital Watermarking for Deep Neural Networkscited by 37
- 2024Unseen Visual Anomaly Generationcited by 23
Built on by
Not cited yet.