IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generation
Not on the map. Why?
Abstract (arXiv)
Recently, zero-shot methods like InstantID have revolutionized identity-preserving generation. Unlike multi-image finetuning approaches such as DreamBooth, these zero-shot methods leverage powerful facial encoders to extract identity information from a single portrait photo, enabling efficient identity-preserving generation through a single inference pass. However, this convenience introduces new threats to the facial identity protection. This paper aims to safeguard portrait photos from unauthorized encoder-based customization. We introduce IDProtector, an adversarial noise encoder that applies imperceptible adversarial noise to portrait photos in a single forward pass. Our approach offers universal protection for portraits against multiple state-of-the-art encoder-based methods, including InstantID, IP-Adapter, and PhotoMaker, while ensuring robustness to common image transformations such as JPEG compression, resizing, and affine transformations. Experiments across diverse portrait datasets and generative models reveal that IDProtector generalizes effectively to unseen data and even closed-source proprietary models.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 16 Dec 2024.
Builds on
25 of 33 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
- 2023Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examplescited by 167
- 2023Raising the Cost of Malicious AI-Powered Image Editingcited by 163
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
13 more
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2020SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustnesscited by 112
- 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attackscited by 81
- 2023Face0: Instantaneously Conditioning a Text-to-Image Model on a Facecited by 78
- 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
- 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 47
- 2023SimAC: A Simple Anti-Customization Method for Protecting Face Privacy against Text-to-Image Synthesis of Diffusion Modelscited by 36
- 2024IDAdapter: Learning Mixed Features for Tuning-Free Personalization of Text-to-Image Modelscited by 32
- 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 29
- 2023DUAW: Data-free Universal Adversarial Watermark against Stable Diffusion Customizationcited by 20
- 2024Anti-Reference: Universal and Immediate Defense Against Reference-Based Generationcited by 18
- 2024Fast Personalized Text-to-Image Syntheses With Attention Injectioncited by 15
Built on by
Citing papers per year: 2024: 1; 2025: 13; 2026: 8.
22 papers.
Sort:
By area:
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
- 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agentscited by 32
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 24
- 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similaritycited by 20
- 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attackscited by 11
- 2025TarPro: Targeted Protection against Malicious Image Editingcited by 7
- 2026Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customizationcited by 5
- 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purificationcited by 3
10 more
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detectioncited by 3
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformercited by 3
- 2026ActionMap: Robot Policy Learning via Voxel Action Heatmapcited by 2
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecyclecited by 2
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
- 2026AutoMIA: Improved Baselines for Membership Inference Attack via Agentic Self-Explorationcited by 0
- 2026Customizing Video Portraits via Identity-ActionDecouplingcited by 0
- 2026IREU: Identity-Related Encoder-Only Unlearning for Customized Portrait Generationcited by 0
- 2026IP Protection in the Era of Visual Generative AI: A Surveycited by 0
- 2026No Way To Steal My Face: Proactive Defense Against Identity-Preserving Personalized Generationcited by 0
- 2026No Way To Steal My Face: Proactive Defense Against Identity-Preserving Personalized Generation14 Oct 2026
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle5 Aug 2026
- 2026Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customization14 Jul 2026
- 2026IREU: Identity-Related Encoder-Only Unlearning for Customized Portrait Generation29 Jun 2026
- 2026Customizing Video Portraits via Identity-ActionDecoupling21 Jun 2026
- 2026ActionMap: Robot Policy Learning via Voxel Action Heatmap5 Jun 2026
- 2026AutoMIA: Improved Baselines for Membership Inference Attack via Agentic Self-Exploration1 Apr 2026
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformer8 Dec 2025
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detection24 Nov 2025
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising5 Nov 2025
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment22 Sep 2025
10 more
- 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purification17 Sep 2025
- 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attacks6 Jun 2025
- 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agents4 Jun 2025
- 2025TarPro: Targeted Protection against Malicious Image Editing18 Mar 2025
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editing13 Mar 2025
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformer10 Mar 2025
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Data20 Feb 2025
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer3 Feb 2025
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks27 Jan 2025
- 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similarity19 Dec 2024
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
- 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similaritycited by 20
- 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purificationcited by 3
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detectioncited by 3
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformercited by 3
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
- 2026No Way To Steal My Face: Proactive Defense Against Identity-Preserving Personalized Generationcited by 0
- 2026No Way To Steal My Face: Proactive Defense Against Identity-Preserving Personalized Generation14 Oct 2026
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformer8 Dec 2025
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detection24 Nov 2025
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising5 Nov 2025
- 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment22 Sep 2025
- 2025Towards Robust Defense against Customization via Protective Perturbation Resistant to Diffusion-based Purification17 Sep 2025
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformer10 Mar 2025
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer3 Feb 2025
- 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similarity19 Dec 2024
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 63
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 24
- 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attackscited by 11
- 2025TarPro: Targeted Protection against Malicious Image Editingcited by 7
- 2026Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customizationcited by 5
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecyclecited by 2
- 2026Customizing Video Portraits via Identity-ActionDecouplingcited by 0
- 2026IP Protection in the Era of Visual Generative AI: A Surveycited by 0
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle5 Aug 2026
- 2026Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customization14 Jul 2026
- 2026Customizing Video Portraits via Identity-ActionDecoupling21 Jun 2026
- 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attacks6 Jun 2025
- 2025TarPro: Targeted Protection against Malicious Image Editing18 Mar 2025
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editing13 Mar 2025
- 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Data20 Feb 2025
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Tasks27 Jan 2025