mlsanityData to 14 Oct 2026

IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generation

arXiv 2412.11638 ↗First posted 16 Dec 2024cs.CVcited by 22

Not on the map. Why?

Abstract (arXiv)

Recently, zero-shot methods like InstantID have revolutionized identity-preserving generation. Unlike multi-image finetuning approaches such as DreamBooth, these zero-shot methods leverage powerful facial encoders to extract identity information from a single portrait photo, enabling efficient identity-preserving generation through a single inference pass. However, this convenience introduces new threats to the facial identity protection. This paper aims to safeguard portrait photos from unauthorized encoder-based customization. We introduce IDProtector, an adversarial noise encoder that applies imperceptible adversarial noise to portrait photos in a single forward pass. Our approach offers universal protection for portraits against multiple state-of-the-art encoder-based methods, including InstantID, IP-Adapter, and PhotoMaker, while ensuring robustness to common image transformations such as JPEG compression, resizing, and affine transformations. Experiments across diverse portrait datasets and generative models reveal that IDProtector generalizes effectively to unseen data and even closed-source proprietary models.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 16 Dec 2024.

Builds on

25 of 33 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  5. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  6. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  7. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  8. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  9. 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
  10. 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 167
  11. 2023Raising the Cost of Malicious AI-Powered Image Editingcited by 163
  12. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
13 more
  1. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
  2. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  3. 2020SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustnesscited by 112
  4. 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attackscited by 81
  5. 2023Face0: Instantaneously Conditioning a Text-to-Image Model on a Facecited by 78
  6. 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
  7. 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 47
  8. 2023SimAC: A Simple Anti-Customization Method for Protecting Face Privacy against Text-to-Image Synthesis of Diffusion Modelscited by 36
  9. 2024IDAdapter: Learning Mixed Features for Tuning-Free Personalization of Text-to-Image Modelscited by 32
  10. 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 29
  11. 2023DUAW: Data-free Universal Adversarial Watermark against Stable Diffusion Customizationcited by 20
  12. 2024Anti-Reference: Universal and Immediate Defense Against Reference-Based Generationcited by 18
  13. 2024Fast Personalized Text-to-Image Syntheses With Attention Injectioncited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 13; 2026: 8.

22 papers.

Sort:

By area:

  1. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  2. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
  3. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  4. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
  5. 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agentscited by 32
  6. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  7. 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 24
  8. 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similaritycited by 20
  9. 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attackscited by 11
  10. 2025TarPro: Targeted Protection against Malicious Image Editingcited by 7
  11. 2026Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customizationcited by 5
  12. 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purificationcited by 3
10 more
  1. 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detectioncited by 3
  2. 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformercited by 3
  3. 2026ActionMap: Robot Policy Learning via Voxel Action Heatmapcited by 2
  4. 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecyclecited by 2
  5. 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
  6. 2026AutoMIA: Improved Baselines for Membership Inference Attack via Agentic Self-Explorationcited by 0
  7. 2026Customizing Video Portraits via Identity-ActionDecouplingcited by 0
  8. 2026IREU: Identity-Related Encoder-Only Unlearning for Customized Portrait Generationcited by 0
  9. 2026IP Protection in the Era of Visual Generative AI: A Surveycited by 0
  10. 2026No Way To Steal My Face: Proactive Defense Against Identity-Preserving Personalized Generationcited by 0