mlsanityData to 14 Oct 2026

Image Watermarks are Removable Using Controllable Regeneration from Clean Noise

arXiv 2410.05470 ↗First posted 7 Oct 2024cs.CR cs.AI cs.CVcited by 50

Not on the map. Why?

Cited by 26 in LLM safety and security, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Image watermark techniques provide an effective way to assert ownership, deter misuse, and trace content sources, which has become increasingly essential in the era of large generative models. A critical attribute of watermark techniques is their robustness against various manipulations. In this paper, we introduce a watermark removal approach capable of effectively nullifying state-of-the-art watermarking techniques. Our primary insight involves regenerating the watermarked image starting from a clean Gaussian noise via a controllable diffusion model, utilizing the extracted semantic and spatial features from the watermarked image. The semantic control adapter and the spatial control network are specifically trained to control the denoising process towards ensuring image quality and enhancing consistency between the cleaned image and the original watermarked image. To achieve a smooth trade-off between watermark removal performance and image consistency, we further propose an adjustable and controllable regeneration scheme. This scheme adds varying numbers of noise steps to the latent representation of the watermarked image, followed by a controlled denoising process starting from this noisy latent representation. As the number of noise steps increases, the latent representation progressively approaches clean Gaussian noise, facilitating the desired trade-off. We apply our watermark removal methods across various watermarking techniques, and the results demonstrate that our methods offer superior visual consistency/quality and enhanced watermark removal performance compared to existing regeneration approaches. Our code is available at https://github.com/yepengliu/CtrlRegen.

Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). Builds on 44 of its 53 references that are in the map. First posted on arXiv 7 Oct 2024.

Builds on

44 of 53 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  12. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
32 more
  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  3. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  5. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  6. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  7. 2023A Watermark for Large Language Modelscited by 725
  8. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  9. 2018HiDDeN: Hiding Data With Deep Networkscited by 397
  10. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
  11. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 304
  12. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
  13. 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 265
  14. 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 213
  15. 2019Robust Invisible Video Watermarking with Attentioncited by 149
  16. 2020Entangled Watermarks as a Defense against Model Extractioncited by 149
  17. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
  18. 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Modelscited by 142
  19. 2023A Recipe for Watermarking Diffusion Modelscited by 141
  20. 2023Invisible Image Watermarks Are Provably Removable Using Generative AIcited by 134
  21. 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 97
  22. 2021Watermarking Images in Self-Supervised Latent Spacescited by 94
  23. 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 91
  24. 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attackscited by 81
  25. 2023Evading Watermark based Detection of AI-Generated Contentcited by 78
  26. 2024Adaptive Text Watermark for Large Language Modelscited by 67
  27. 2023Leveraging Optimization for Adaptive Attacks on Image Watermarkscited by 52
  28. 2024Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Modelcited by 45
  29. 2024Stable-Hair: Real-World Hair Transfer via Diffusion Modelcited by 35
  30. 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Modelscited by 31
  31. 2024LaWa: Using Latent Space for In-Generation Image Watermarkingcited by 28
  32. 2024A Transfer Attack to Image Watermarkscited by 27

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 26; 2026: 21.

50 papers.

Sort:

By area:

  1. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  2. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
  3. 2024Black-Box Forgery Attacks on Semantic Watermarks for Diffusion Modelscited by 52
  4. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  5. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  6. 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similaritycited by 20
  7. 2024De-mark: Watermark Removal in Large Language Modelscited by 14
  8. 2025Forging and Removing Latent-Noise Diffusion Watermarks Using a Single Imagecited by 13
  9. 2025Dataset Protection via Watermarked Canaries in Retrieval-Augmented LLMscited by 12
  10. 2025Transferable Black-Box One-Shot Forging of Watermarks via Image Preference Modelscited by 12
  11. 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attackscited by 11
  12. 2025In-Context Watermarks for Large Language Modelscited by 10
38 more
  1. 2025OpenFake: An Open Dataset and Platform Toward Real-World Deepfake Detectioncited by 10
  2. 2025First-Place Solution to NeurIPS 2024 Invisible Watermark Removal Challengecited by 9
  3. 2025Autoregressive Images Watermarking through Lexical Biasing: An Approach Resistant to Regeneration Attackcited by 8
  4. 2025Enhancing Text-to-Image Diffusion Transformer via Split-Text Conditioningcited by 7
  5. 2025Position: LLM Watermarking Should Align Stakeholders' Incentives for Practical Adoptioncited by 7
  6. 2025Radioactive Watermarks in Diffusion and Autoregressive Image Generative Modelscited by 6
  7. 2025BitMark: Watermarking Bitwise Autoregressive Image Generative Modelscited by 5
  8. 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Surveycited by 5
  9. 2026SHIFT: Stochastic Hidden-Trajectory Deflection for Removing Diffusion-based Watermarkcited by 4
  10. 2025Optimization-Free Universal Watermark Forgery with Regenerative Diffusion Modelscited by 3
  11. 2025Fast, Secure, and High-Capacity Image Watermarking with Autoencoded Text Vectorscited by 3
  12. 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detectioncited by 3
  13. 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformercited by 3
  14. 2026Towards Robust Content Watermarking Against Removal and Forgery Attackscited by 3
  15. 2025When and Where do Data Poisons Attack Textual Inversion?cited by 2
  16. 2025Boosting Adversarial Transferability via Commonality-Oriented Gradient Optimizationcited by 1
  17. 2025MetaSeal: Defending Against Image Attribution Forgery Through Content-Dependent Cryptographic Watermarkscited by 1
  18. 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
  19. 2025TokenPure: Watermark Removal through Tokenized Appearance and Structural Guidancecited by 1
  20. 2026Attention to Neural Plagiarism: Diffusion Models Can Plagiarize Your Copyrighted Images!cited by 1
  21. 2026AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspectivecited by 1
  22. 2026On the Robustness of Watermarking for Autoregressive Image Generationcited by 1
  23. 2026The Forensic Cost of Watermark Removal: From Dedicated Attacks to Image Editingcited by 1
  24. 2026Removing the Watermark Is Not Enough: Forensic Stealth in Generative-AI Watermark Removalcited by 1
  25. 2026MarkNull: Model-Agnostic Watermark Removal in AI-Generated Images via On-Manifold Latent Manipulationcited by 1
  26. 2026MarkCleaner: High-Fidelity Watermark Removal via Imperceptible Micro-Geometric Perturbationcited by 0
  27. 2026SERUM: Simple, Efficient, Robust, and Unifying Marking for Diffusion-based Image Generationcited by 0
  28. 2026PGID: Progressive Guided Inversion and Denoising for Robust Watermark Detectioncited by 0
  29. 2026Learning to Follow In-Context Watermark Instructions via Self-Distillationcited by 0
  30. 2026One Prompt Is Enough: Watermark Laundering Through Foundation Image Modelscited by 0
  31. 2026DRIFT: Removing Diffusion Watermarks by Deflecting the Generative Trajectorycited by 0
  32. 2026Disentangle and Drop: Robust Universal Removal of Image Watermarks via Reconstructive Grayscale Residual Decompositioncited by 0
  33. 2026RemTraceNet: Few-Shot Forensic Detection of Invisible Watermark Attackscited by 0
  34. 2026Where Does the Watermark Hide? Push-Pull Disentanglement for Invisible Watermark Removalcited by 0
  35. 2026Persistent Watermarking of Text-to-Image Modelscited by 0
  36. 2026WARP: A Unified Benchmark for Invisible Image Watermarking -- Robustness and Protection Against Attackscited by 0
  37. 2026LiBRA: Detection-Aware Image Watermark Removal via Bidirectional Latent Optimizationcited by 0
  38. 2026WaveMark: Robust Wavelet-Domain Image Watermarking for Diffusion Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing
  2. 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks
  3. 2025Saliency-Aware Diffusion Reconstruction for Effective Invisible Watermark Removal
  4. 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarking
  5. 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarking
  6. 2025On the Information-Theoretic Fragility of Robust Watermarking under Diffusion Editing
  7. 2025Diffusion-Based Image Editing for Breaking Robust Watermarks
  8. 2024SuperMark: Robust and Training-free Image Watermarking via Diffusion-based Super-Resolution