Understanding Semantic Perturbations on In-Processing Generative Image Watermarks
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
The widespread deployment of high-fidelity generative models has intensified the need for reliable mechanisms for provenance and content authentication. In-processing watermarking, embedding a signature into the generative model's synthesis procedure, has been advocated as a solution and is often reported to be robust to standard post-processing (such as geometric transforms and filtering). Yet robustness to semantic manipulations that alter high-level scene content while maintaining reasonable visual quality is not well studied or understood. We introduce a simple, multi-stage framework for systematically stress-testing in-processing generative watermarks under semantic drift. The framework utilizes off-the-shelf models for object detection, mask generation, and semantically guided inpainting or regeneration to produce controlled, meaning-altering edits with minimal perceptual degradation. Based on extensive experiments on representative schemes, we find that robustness varies significantly with the degree of semantic entanglement: methods by which watermarks remain detectable under a broad suite of conventional perturbations can fail under semantic edits, with watermark detectability in many cases dropping to near zero while image quality remains high. Overall, our results reveal a critical gap in current watermarking evaluations and suggest that watermark designs and benchmarking must explicitly account for robustness against semantic manipulation.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 26 of its 38 references that are in the map. First posted on arXiv 29 Mar 2026.
Builds on
26 of 38 references.
Closest ancestors · 5
Same direction, newest first
- 2025TAG-WM: Tamper-Aware Generative Image Watermarking via Diffusion Inversion Sensitivity30 Jun
- 2025Removing Watermarks with Partial Regeneration using Semantic Information13 May
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advances24 Oct
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
Other references · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2017Mask R-CNNcited by 7,259
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 216
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2019Robust Invisible Video Watermarking with Attentioncited by 144
9 more
- 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusioncited by 114
- 2021Watermarking Images in Self-Supervised Latent Spacescited by 90
- 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 89
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2023LLM4SGG: Large Language Models for Weakly Supervised Scene Graph Generationcited by 30
- 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similaritycited by 20
- 2024UnMarker: A Universal Attack on Defensive Image Watermarkingcited by 19
- 2025SEAL: Semantic Aware Image Watermarkingcited by 13
- 2025SpecGuard: Spectral Projection-based Advanced Invisible Watermarkingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.