RoWSFormer: A Robust Watermarking Framework with Swin Transformer for Enhanced Geometric Attack Resilience
Not on the map. Why?
Abstract (arXiv)
In recent years, digital watermarking techniques based on deep learning have been widely studied. To achieve both imperceptibility and robustness of image watermarks, most current methods employ convolutional neural networks to build robust watermarking frameworks. However, despite the success of CNN-based watermarking models, they struggle to achieve robustness against geometric attacks due to the limitations of convolutional neural networks in capturing global and long-range relationships. To address this limitation, we propose a robust watermarking framework based on the Swin Transformer, named RoWSFormer. Specifically, we design the Locally-Channel Enhanced Swin Transformer Block as the core of both the encoder and decoder. This block utilizes the self-attention mechanism to capture global and long-range information, thereby significantly improving adaptation to geometric distortions. Additionally, we construct the Frequency-Enhanced Transformer Block to extract frequency domain information, which further strengthens the robustness of the watermarking framework. Experimental results demonstrate that our RoWSFormer surpasses existing state-of-the-art watermarking methods. For most non-geometric attacks, RoWSFormer improves the PSNR by 3 dB while maintaining the same extraction accuracy. In the case of geometric attacks (such as rotation, scaling, and affine transformations), RoWSFormer achieves over a 6 dB improvement in PSNR, with extraction accuracy exceeding 97%.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 47 references that are in the map. First posted on arXiv 23 Sep 2024.
Builds on
23 of 47 references.
References · 23
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Segment Anythingcited by 8,158
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2021Remote Sensing Image Change Detection with Transformerscited by 305
11 more
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
- 2021MBRS : Enhancing Robustness of DNN-based Watermarking by Mini-Batch of Real and Simulated JPEG Compressioncited by 108
- 2017Generating Steganographic Images via Adversarial Trainingcited by 57
- 2018ReDMark: Framework for Residual Diffusion Watermarking on Deep Networkscited by 55
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
- 2022FECAM: Frequency Enhanced Channel Attention Mechanism for Time Series Forecastingcited by 15
- 2023Practical Deep Dispersed Watermarking with Synchronization and Fusioncited by 15
- 2022De-END: Decoder-driven Watermarking Networkcited by 12
- 2024Robust Message Embedding via Attention Flow-Based Steganographycited by 5
- 2023Smaller Is Bigger: Rethinking the Embedding Rate of Deep Hidingcited by 1
Built on by
Citing papers per year: 2024: 1.
1 paper.