My Art My Choice: Adversarial Protection Against Unruly AI
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Generative AI is on the rise, enabling everyone to produce realistic content via publicly available interfaces. Especially for guided image generation, diffusion models are changing the creator economy by producing high quality low cost content. In parallel, artists are rising against unruly AI, since their artwork are leveraged, distributed, and dissimulated by large generative models. Our approach, My Art My Choice (MAMC), aims to empower content owners by protecting their copyrighted materials from being utilized by diffusion models in an adversarial fashion. MAMC learns to generate adversarially perturbed "protected" versions of images which can in turn "break" diffusion models. The perturbation amount is decided by the artist to balance distortion vs. protection of the content. MAMC is designed with a simple UNet-based generator, attacking black box diffusion models, combining several losses to create adversarial twins of the original artwork. We experiment on three datasets for various image-to-image tasks, with different user control values. Both protected image and diffusion output results are evaluated in visual, noise, structure, pixel, and generative spaces to validate our claims. We believe that MAMC is a crucial step for preserving ownership information for AI generated content in a flawless, based-on-need, and human-centric way.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 36 of its 52 references that are in the map. First posted on arXiv 6 Sep 2023.
Builds on
36 of 52 references.
Closest ancestors · 2
Same direction, newest first
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesis27 Mar
- 2023Raising the Cost of Malicious AI-Powered Image Editing13 Feb
Other references · 34
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
22 more
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
- 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
- 2021Fast Yet Effective Machine Unlearningcited by 209
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
- 2016View Synthesis by Appearance Flowcited by 172
- 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
- 2021LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognitioncited by 92
- 2023TaleCrafter: Interactive Story Visualization with Multiple Characterscited by 71
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 42
- 2021Adversarial Attacks Against Deep Generative Models on Data: A Surveycited by 23
- 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Modelcited by 20
- 2023Training Data Protection with Compositional Diffusion Modelscited by 16
- 2023The Best Defense is a Good Offense: Adversarial Augmentation against Adversarial Attackscited by 15
- 2022My Face My Choice: Privacy Enhancing Deepfakes for Social Media Anonymizationcited by 14
Built on by
Citing papers per year: 2024: 4; 2025: 1.
5 papers.
- 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
- 2024PRIME: Protect Your Videos From Malicious Editingcited by 9
- 2024A Survey on Responsible Generative AI: What to Generate and What Notcited by 8
- 2024Image Copy Detection for Diffusion Modelscited by 4
- 2025GuardDoor: Safeguarding Against Malicious Diffusion Editing via Protective Backdoorscited by 4
- 2025GuardDoor: Safeguarding Against Malicious Diffusion Editing via Protective Backdoors5 Mar 2025
- 2024Image Copy Detection for Diffusion Models30 Sep 2024
- 2024Replication in Visual Diffusion Models: A Survey and Outlook7 Jul 2024
- 2024A Survey on Responsible Generative AI: What to Generate and What Not8 Apr 2024
- 2024PRIME: Protect Your Videos From Malicious Editing2 Feb 2024
Similar, not cited
Close in wording, no citation either way
- 2023Measuring the Success of Diffusion Models at Imitating Human Artists
- 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examples
- 2023Mist: Towards Improved Adversarial Examples for Diffusion Models
- 2023Can Protective Perturbation Safeguard Personal Data from Being Exploited by Stable Diffusion?
- 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AI
- 2024Copyright-Aware Incentive Scheme for Generative Art Models Using Hierarchical Reinforcement Learning
- 2024Organic or Diffused: Can We Distinguish Human Art from AI-generated Images?
- 2025Evaluating Adversarial Protections for Diffusion Personalization: A Comprehensive Study