mlsanityData to 7 Oct 2026

My Art My Choice: Adversarial Protection Against Unruly AI

arXiv 2309.03198 ↗First posted 6 Sep 2023cs.CV cs.AIcited by 5

On the map: Diffusion models → Robustness, privacy and adversarial aspects

Abstract (arXiv)

Generative AI is on the rise, enabling everyone to produce realistic content via publicly available interfaces. Especially for guided image generation, diffusion models are changing the creator economy by producing high quality low cost content. In parallel, artists are rising against unruly AI, since their artwork are leveraged, distributed, and dissimulated by large generative models. Our approach, My Art My Choice (MAMC), aims to empower content owners by protecting their copyrighted materials from being utilized by diffusion models in an adversarial fashion. MAMC learns to generate adversarially perturbed "protected" versions of images which can in turn "break" diffusion models. The perturbation amount is decided by the artist to balance distortion vs. protection of the content. MAMC is designed with a simple UNet-based generator, attacking black box diffusion models, combining several losses to create adversarial twins of the original artwork. We experiment on three datasets for various image-to-image tasks, with different user control values. Both protected image and diffusion output results are evaluated in visual, noise, structure, pixel, and generative spaces to validate our claims. We believe that MAMC is a crucial step for preserving ownership information for AI generated content in a flawless, based-on-need, and human-centric way.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 36 of its 52 references that are in the map. First posted on arXiv 6 Sep 2023.

Builds on

36 of 52 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesis27 Mar
  2. 2023Raising the Cost of Malicious AI-Powered Image Editing13 Feb

Other references · 34

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  9. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  10. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  11. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  12. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
22 more
  1. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  2. 2023Zero-shot Image-to-Image Translationcited by 503
  3. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  4. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  5. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  6. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  7. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  8. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
  9. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
  10. 2021Fast Yet Effective Machine Unlearningcited by 209
  11. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
  12. 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
  13. 2016View Synthesis by Appearance Flowcited by 172
  14. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
  15. 2021LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognitioncited by 92
  16. 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 71
  17. 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 42
  18. 2021Adversarial Attacks Against Deep Generative Models on Data: A Surveycited by 23
  19. 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Modelcited by 20
  20. 2023Training Data Protection with Compositional Diffusion Modelscited by 16
  21. 2023The Best Defense is a Good Offense: Adversarial Augmentation against Adversarial Attackscited by 15
  22. 2022My Face My Choice: Privacy Enhancing Deepfakes for Social Media Anonymizationcited by 14

Built on by

Cited by year

Citing papers per year: 2024: 4; 2025: 1.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Measuring the Success of Diffusion Models at Imitating Human Artists
  2. 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examples
  3. 2023Mist: Towards Improved Adversarial Examples for Diffusion Models
  4. 2023Can Protective Perturbation Safeguard Personal Data from Being Exploited by Stable Diffusion?
  5. 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AI
  6. 2024Copyright-Aware Incentive Scheme for Generative Art Models Using Hierarchical Reinforcement Learning
  7. 2024Organic or Diffused: Can We Distinguish Human Art from AI-generated Images?
  8. 2025Evaluating Adversarial Protections for Diffusion Personalization: A Comprehensive Study