Generative Unlearning for Any Identity
On the map: LLM safety and security → Vision-language and text-to-image safety
Abstract (arXiv)
Recent advances in generative models trained on large-scale datasets have made it possible to synthesize high-quality samples across various domains. Moreover, the emergence of strong inversion networks enables not only a reconstruction of real-world images but also the modification of attributes through various editing methods. However, in certain domains related to privacy issues, e.g., human faces, advanced generative models along with strong inversion methods can lead to potential misuses. In this paper, we propose an essential yet under-explored task called generative identity unlearning, which steers the model not to generate an image of a specific identity. In the generative identity unlearning, we target the following objectives: (i) preventing the generation of images with a certain identity, and (ii) preserving the overall quality of the generative model. To satisfy these goals, we propose a novel framework, Generative Unlearning for Any Identity (GUIDE), which prevents the reconstruction of a specific identity by unlearning the generator with only a single image. GUIDE consists of two parts: (i) finding a target point for optimization that un-identifies the source latent code and (ii) novel loss functions that facilitate the unlearning procedure while less affecting the learned distribution. Our extensive experiments demonstrate that our proposed method achieves state-of-the-art performance in the generative machine unlearning task. The code is available at https://github.com/KHU-AGI/GUIDE.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 48 of its 57 references that are in the map. First posted on arXiv 16 May 2024.
Builds on
48 of 57 references.
Closest ancestors · 2
Same direction, newest first
- 2023Adapt then Unlearn: Exploring Parameter Space Semantics for Unlearning in Generative Adversarial Networks25 Sep
- 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models30 Mar
Other references · 46
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
34 more
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2023Erasing Concepts from Diffusion Modelscited by 530
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2017Adversarial Examples: Attacks and Defenses for Deep Learningcited by 350
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
- 2023Ablating Concepts in Text-to-Image Diffusion Modelscited by 312
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2021Fast Yet Effective Machine Unlearningcited by 209
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2020Forgetting Outside the Box: Scrubbing Deep Networks of Information Accessible from Input-Output Observationscited by 171
- 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
- 2021Adaptive Machine Unlearningcited by 164
- 2020Mixed-Privacy Forgetting in Deep Networkscited by 158
- 2022Zero-Shot Machine Unlearningcited by 125
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
- 2020Machine Unlearning: Linear Filtration for Logit-based Classifierscited by 89
- 2022Deep Unlearning via Randomized Conditionally Independent Hessianscited by 83
- 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
- 2022AniFaceGAN: Animatable 3D-Aware Face Image Generation for Video Avatarscited by 46
- 2023Make Encoder Great Again in 3D GAN Inversion through Geometry and Occlusion-Aware Encodingcited by 35
- 2023Online Class Incremental Learning on Stochastic Blurry Task Boundary via Mask and Visual Prompt Tuningcited by 35
- 2021SSSE: Efficiently Erasing Samples from Trained Machine Learning Modelscited by 28
- 2022Data Redaction from Pre-trained GANscited by 18
- 2023LFS-GAN: Lifelong Few-Shot Image Generationcited by 11
- 2022IntereStyle: Encoding an Interest Region for Robust StyleGAN Inversioncited by 8
Built on by
Citing papers per year: 2024: 3; 2025: 8; 2026: 8.
19 papers.
Sort:
By area:
- 2024MUNBa: Machine Unlearning via Nash Bargainingcited by 17
- 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertaintycited by 12
- 2024Versatile Incremental Learning: Towards Class and Domain-Agnostic Incremental Learningcited by 9
- 2025ESC: Erasing Space Concept for Knowledge Deletioncited by 9
- 2025Rethinking Machine Unlearning in Image Generation Modelscited by 9
- 2025Do Not Mimic My Voice: Speaker Identity Unlearning for Zero-Shot Text-to-Speechcited by 6
- 2024Online Continuous Generalized Category Discoverycited by 5
- 2025Perturb a Model, Not an Image: Towards Robust Privacy Protection via Anti-Personalized Diffusion Modelscited by 2
- 2025Mitigating Data Exfiltration Attacks through Layer-Wise Learning Rate Decay Fine-Tuningcited by 1
- 2025No Encore: Unlearning as Opt-Out in Music Generationcited by 1
- 2025SUGAR: A Sweeter Spot for Generative Unlearning of Many Identitiescited by 1
- 2026Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Modelscited by 1
7 more
- 2026PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Modelscited by 1
- 2026Efficient Unlearning through Maximizing Relearning Convergence Delaycited by 0
- 2026Not Every Subject Should Stay: Machine Unlearning for Noisy Engagement Recognitioncited by 0
- 2026CoreUnlearn: Rethinking Concept Unlearning through Disentangled Component-Level Erasure in Text-guided Diffusion Modelscited by 0
- 2026IREU: Identity-Related Encoder-Only Unlearning for Customized Portrait Generationcited by 0
- 2026Damnatio Memoriae: Adversarially and Selectively Forgetting Identities in the Embedding Space of Face Recognition Modelscited by 0
- 2026DARE to Mitigate Hallucination: Dual-path Auto-Regressive-aware Editingcited by 0
- 2026DARE to Mitigate Hallucination: Dual-path Auto-Regressive-aware Editing29 Sep 2026
- 2026Damnatio Memoriae: Adversarially and Selectively Forgetting Identities in the Embedding Space of Face Recognition Models22 Sep 2026
- 2026IREU: Identity-Related Encoder-Only Unlearning for Customized Portrait Generation29 Jun 2026
- 2026CoreUnlearn: Rethinking Concept Unlearning through Disentangled Component-Level Erasure in Text-guided Diffusion Models1 Jun 2026
- 2026PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Models21 May 2026
- 2026Not Every Subject Should Stay: Machine Unlearning for Noisy Engagement Recognition6 May 2026
- 2026Efficient Unlearning through Maximizing Relearning Convergence Delay10 Apr 2026
- 2026Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Models11 Mar 2026
- 2025SUGAR: A Sweeter Spot for Generative Unlearning of Many Identities6 Dec 2025
- 2025Perturb a Model, Not an Image: Towards Robust Privacy Protection via Anti-Personalized Diffusion Models3 Nov 2025
- 2025No Encore: Unlearning as Opt-Out in Music Generation8 Sep 2025
- 2025Mitigating Data Exfiltration Attacks through Layer-Wise Learning Rate Decay Fine-Tuning20 Aug 2025
7 more
- 2025Do Not Mimic My Voice: Speaker Identity Unlearning for Zero-Shot Text-to-Speech27 Jul 2025
- 2025Rethinking Machine Unlearning in Image Generation Models3 Jun 2025
- 2025ESC: Erasing Space Concept for Knowledge Deletion3 Apr 2025
- 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty24 Mar 2025
- 2024MUNBa: Machine Unlearning via Nash Bargaining23 Nov 2024
- 2024Versatile Incremental Learning: Towards Class and Domain-Agnostic Incremental Learning17 Sep 2024
- 2024Online Continuous Generalized Category Discovery24 Aug 2024
- 2024MUNBa: Machine Unlearning via Nash Bargainingcited by 17
- 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertaintycited by 12
- 2025Rethinking Machine Unlearning in Image Generation Modelscited by 9
- 2025Do Not Mimic My Voice: Speaker Identity Unlearning for Zero-Shot Text-to-Speechcited by 6
- 2025No Encore: Unlearning as Opt-Out in Music Generationcited by 1
- 2025SUGAR: A Sweeter Spot for Generative Unlearning of Many Identitiescited by 1
- 2026Efficient Unlearning through Maximizing Relearning Convergence Delaycited by 0
- 2026Not Every Subject Should Stay: Machine Unlearning for Noisy Engagement Recognitioncited by 0
- 2026IREU: Identity-Related Encoder-Only Unlearning for Customized Portrait Generationcited by 0
- 2026IREU: Identity-Related Encoder-Only Unlearning for Customized Portrait Generation29 Jun 2026
- 2026Not Every Subject Should Stay: Machine Unlearning for Noisy Engagement Recognition6 May 2026
- 2026Efficient Unlearning through Maximizing Relearning Convergence Delay10 Apr 2026
- 2025SUGAR: A Sweeter Spot for Generative Unlearning of Many Identities6 Dec 2025
- 2025No Encore: Unlearning as Opt-Out in Music Generation8 Sep 2025
- 2025Do Not Mimic My Voice: Speaker Identity Unlearning for Zero-Shot Text-to-Speech27 Jul 2025
- 2025Rethinking Machine Unlearning in Image Generation Models3 Jun 2025
- 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty24 Mar 2025
- 2024MUNBa: Machine Unlearning via Nash Bargaining23 Nov 2024
- 2025Perturb a Model, Not an Image: Towards Robust Privacy Protection via Anti-Personalized Diffusion Modelscited by 2
- 2026Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Modelscited by 1
- 2026PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Modelscited by 1
- 2026CoreUnlearn: Rethinking Concept Unlearning through Disentangled Component-Level Erasure in Text-guided Diffusion Modelscited by 0
- 2026CoreUnlearn: Rethinking Concept Unlearning through Disentangled Component-Level Erasure in Text-guided Diffusion Models1 Jun 2026
- 2026PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Models21 May 2026
- 2026Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Models11 Mar 2026
- 2025Perturb a Model, Not an Image: Towards Robust Privacy Protection via Anti-Personalized Diffusion Models3 Nov 2025
- 2024Versatile Incremental Learning: Towards Class and Domain-Agnostic Incremental Learningcited by 9
- 2025ESC: Erasing Space Concept for Knowledge Deletioncited by 9
- 2024Online Continuous Generalized Category Discoverycited by 5
- 2025Mitigating Data Exfiltration Attacks through Layer-Wise Learning Rate Decay Fine-Tuningcited by 1
- 2026Damnatio Memoriae: Adversarially and Selectively Forgetting Identities in the Embedding Space of Face Recognition Modelscited by 0
- 2026Damnatio Memoriae: Adversarially and Selectively Forgetting Identities in the Embedding Space of Face Recognition Models22 Sep 2026
- 2025Mitigating Data Exfiltration Attacks through Layer-Wise Learning Rate Decay Fine-Tuning20 Aug 2025
- 2025ESC: Erasing Space Concept for Knowledge Deletion3 Apr 2025
- 2024Versatile Incremental Learning: Towards Class and Domain-Agnostic Incremental Learning17 Sep 2024
- 2024Online Continuous Generalized Category Discovery24 Aug 2024