mlsanityData to 7 Oct 2026

WaterMAS: Sharpness-Aware Maximization for Neural Network Watermarking

arXiv 2409.03902 ↗First posted 5 Sep 2024cs.LG cs.CR cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Nowadays, deep neural networks are used for solving complex tasks in several critical applications and protecting both their integrity and intellectual property rights (IPR) has become of utmost importance. To this end, we advance WaterMAS, a substitutive, white-box neural network watermarking method that improves the trade-off among robustness, imperceptibility, and computational complexity, while making provisions for increased data payload and security. WasterMAS insertion keeps unchanged the watermarked weights while sharpening their underlying gradient space. The robustness is thus ensured by limiting the attack's strength: even small alterations of the watermarked weights would impact the model's performance. The imperceptibility is ensured by inserting the watermark during the training process. The relationship among the WaterMAS data payload, imperceptibility, and robustness properties is discussed. The secret key is represented by the positions of the weights conveying the watermark, randomly chosen through multiple layers of the model. The security is evaluated by investigating the case in which an attacker would intercept the key. The experimental validations consider 5 models and 2 tasks (VGG16, ResNet18, MobileNetV3, SwinT for CIFAR10 image classification, and DeepLabV3 for Cityscapes image segmentation) as well as 4 types of attacks (Gaussian noise addition, pruning, fine-tuning, and quantization). The code will be released open-source upon acceptance of the article.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 5 Sep 2024.

Builds on

28 of 43 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  7. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  8. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  9. 2019Searching for MobileNetV3cited by 1,984
  10. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  11. 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,337
  12. 2017Exploring Generalization in Deep Learningcited by 595
16 more
  1. 2017Learning Sparse Neural Networks through L0 Regularizationcited by 571
  2. 2019Fantastic Generalization Measures and Where to Find Themcited by 507
  3. 2017Sharp Minima Can Generalize For Deep Netscited by 462
  4. 2016Entropy-SGD: Biasing Gradient Descent Into Wide Valleyscited by 357
  5. 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
  6. 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 324
  7. 2017Embedding Watermarks into Deep Neural Networkscited by 227
  8. 2016Why does deep and cheap learning work so well?cited by 100
  9. 2022Improving Generalization in Federated Learning by Seeking Flat Minimacited by 98
  10. 2021Flattening Sharpness for Dynamic Gradient Projection Memory Benefits Continual Learningcited by 71
  11. 2021A survey of deep neural network watermarking techniquescited by 69
  12. 2020Spread-Transform Dither Modulation Watermarking of Deep Neural Networkcited by 23
  13. 2018Object Detection in Equirectangular Panoramacited by 20
  14. 2016Training Recurrent Neural Networks by Diffusioncited by 8
  15. 2020Pruning artificial neural networks: a way to find well-generalizing, high-entropy sharp minimacited by 8
  16. 2020RONELD: Robust Neural Network Output Enhancement for Active Lane Detectioncited by 5

Built on by

Not cited yet.