When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Robust invisible watermarking systems aim to embed imperceptible payloads that remain decodable after common post-processing such as JPEG compression, cropping, and additive noise. In parallel, diffusion-based image editing has rapidly matured into a default transformation layer for modern content pipelines, enabling instruction-based editing, object insertion and composition, and interactive geometric manipulation. This paper studies a subtle but increasingly consequential interaction between these trends: diffusion-based editing procedures may unintentionally compromise, and in extreme cases practically bypass, robust watermarking mechanisms that were explicitly engineered to survive conventional distortions. We develop a unified view of diffusion editors that (i) inject substantial Gaussian noise in a latent space and (ii) project back to the natural image manifold via learned denoising dynamics. Under this view, watermark payloads behave as low-energy, high-frequency signals that are systematically attenuated by the forward diffusion step and then treated as nuisance variation by the reverse generative process. We formalize this degradation using information-theoretic tools, proving that for broad classes of pixel-level watermark encoders/decoders the mutual information between the watermark payload and the edited output decays toward zero as the editing strength increases, yielding decoding error close to random guessing. We complement the theory with a realistic hypothetical experimental protocol and tables spanning representative watermarking methods and representative diffusion editors. Finally, we discuss ethical implications, responsible disclosure norms, and concrete design guidelines for watermarking schemes that remain meaningful in the era of generative transformations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 118 of its 158 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
118 of 158 references.
Closest ancestors · 9
Same direction, newest first
- 2025On the Information-Theoretic Fragility of Robust Watermarking under Diffusion Editing14 Nov
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks5 Nov
- 2025Diffusion-Based Image Editing for Breaking Robust Watermarks7 Oct
- 2025Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Models30 Sep
- 2024EraseAnything: Enabling Concept Erasure in Rectified Flow Transformers29 Dec
- 2024An Undetectable Watermark for Generative Image Models9 Oct
- 2024FedBiP: Heterogeneous One-Shot Federated Learning with Personalized Latent Diffusion Models7 Oct
- 2024MACE: Mass Concept Erasure in Diffusion Models10 Mar
- 2024Attack-Resilient Image Watermarking Using Stable Diffusion8 Jan
Other references · 109
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 256
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
38 more
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AIcited by 124
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 105
- 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
- 2024CATCH: Channel-Aware multivariate Time Series Anomaly Detection via Frequency Patchingcited by 91
- 2020Distortion Agnostic Deep Watermarkingcited by 88
- 2024Diffusion Models in Low-Level Vision: A Surveycited by 73
- 2023Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Modelcited by 69
- 2024UltraPixel: Advancing Ultra-High-Resolution Image Synthesis to New Peakscited by 64
- 2023Towards Unified Token Learning for Vision-Language Trackingcited by 62
- 2025Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Conceptscited by 61
- 2025A Comprehensive Survey of Deep Learning for Multivariate Time Series Forecasting: A Channel Strategy Perspectivecited by 58
- 2025TAB: Unified Benchmarking of Time Series Anomaly Detection Methodscited by 58
- 2024The Ninth NTIRE 2024 Efficient Super-Resolution Challenge Reportcited by 57
- 2025PRISM: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selectioncited by 57
- 2021Person Re-identification Method Based on Color Attack and Joint Defencecited by 56
- 2023Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objectscited by 56
- 2024Towards Realistic Data Generation for Real-World Super-Resolutioncited by 56
- 2024RainMamba: Enhanced Locality Learning with State Space Models for Video Derainingcited by 56
- 2025Rethinking Irregular Time Series Forecasting: A Simple yet Effective Baselinecited by 54
- 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methodscited by 52
- 2023TrustMark: Universal Watermarking for Arbitrary Resolution Imagescited by 50
- 2025CoT-Kinetics: A Theoretical Modeling Assessing LRM Reasoning Processcited by 50
- 2025Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modelingcited by 47
- 2024Lightweight Adaptive Feature De-drifting for Compressed Image Classificationcited by 46
- 2024Cross-Modality Perturbation Synergy Attack for Person Re-identificationcited by 45
- 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 44
- 2021Eliminate Deviation with Deviation for Data Augmentation and a General Multi-modal Data Learning Methodcited by 42
- 2025OFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrievalcited by 40
- 2024A Survey of Camouflaged Object Detection and Beyondcited by 37
- 2023HQG-Net: Unpaired Medical Image Enhancement with High-Quality Guidancecited by 36
- 2024Efficient Real-world Image Super-Resolution Via Adaptive Directional Gradient Convolutioncited by 36
- 2025ASCD: Attention-Steerable Contrastive Decoding for Reducing Hallucination in MLLMcited by 36
- 2025MQuant: Unleashing the Inference Potential of Multimodal Large Language Models via Full Static Quantizationcited by 35
50 most cited of 109 All 109 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarking
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarking
- 2026ShapeMark: Robust and Diversity-Preserving Watermarking for Diffusion Models
- 2024Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Space
- 2024JIGMARK: A Black-Box Approach for Enhancing Image Watermarks against Diffusion Model Edits
- 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noise
- 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models
- 2025PT-Mark: Invisible Watermarking for Text-to-image Diffusion Models via Semantic-aware Pivotal Tuning