mlsanityData to 7 Oct 2026

Attribute-preserving Face Dataset Anonymization via Latent Code Optimization

arXiv 2303.11296 ↗First posted 20 Mar 2023cs.CVcited by 43

Not on the map. Why?

Abstract (arXiv)

This work addresses the problem of anonymizing the identity of faces in a dataset of images, such that the privacy of those depicted is not violated, while at the same time the dataset is useful for downstream task such as for training machine learning models. To the best of our knowledge, we are the first to explicitly address this issue and deal with two major drawbacks of the existing state-of-the-art approaches, namely that they (i) require the costly training of additional, purpose-trained neural networks, and/or (ii) fail to retain the facial attributes of the original images in the anonymized counterparts, the preservation of which is of paramount importance for their use in downstream tasks. We accordingly present a task-agnostic anonymization procedure that directly optimizes the images' latent representation in the latent space of a pre-trained GAN. By optimizing the latent codes directly, we ensure both that the identity is of a desired distance away from the original (with an identity obfuscation loss), whilst preserving the facial attributes (using a novel feature-matching loss in FaRL's deep feature space). We demonstrate through a series of both qualitative and quantitative experiments that our method is capable of anonymizing the identity of the images whilst -- crucially -- better-preserving the facial attributes. We make the code and the pre-trained models publicly available at: https://github.com/chi0tzp/FALCO.

Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 20 Mar 2023.

Builds on

32 of 49 references.

References · 32

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  4. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  5. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  6. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  7. 2014Conditional Generative Adversarial Netscited by 2,152
  8. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  9. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
  10. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
  11. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  12. 2014Learning Face Representation from Scratchcited by 451
20 more
  1. 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
  2. 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
  3. 2019DeepPrivacy: A Generative Adversarial Network for Face Anonymizationcited by 108
  4. 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
  5. 2020CIAGAN: Conditional Identity Anonymization Generative Adversarial Networkscited by 88
  6. 2021Anycost GANs for Interactive Image Synthesis and Editingcited by 54
  7. 2019AnonymousNet: Natural Face De-Identification with Measurable Privacycited by 50
  8. 2021WarpedGANSpace: Finding non-linear RBF paths in GAN latent spacecited by 48
  9. 2016Defeating Image Obfuscation with Deep Learningcited by 43
  10. 2016Faceless Person Recognition; Privacy Implications in Social Mediacited by 27
  11. 2021IdentityDP: Differential Private Identification Protection for Face Imagescited by 24
  12. 2022PandA: Unsupervised Learning of Parts and Appearances in the Feature Maps of GANscited by 20
  13. 2022StyleMask: Disentangling the Style Space of StyleGAN2 for Neural Face Reenactmentcited by 17
  14. 2018SchiNet: Automatic Estimation of Symptoms of Schizophrenia from Facial Behaviour Analysiscited by 16
  15. 2018Privacy-Protective-GAN for Face De-identificationcited by 14
  16. 2021Tensor Component Analysis for Interpreting the Latent Space of GANscited by 13
  17. 2021CFA-Net: Controllable Face Anonymization Network with Identity Representation Manipulationcited by 12
  18. 2022ContraCLIP: Interpretable GAN generation driven by pairs of contrasting sentencescited by 12
  19. 2021Graph-based Generative Face Anonymisation with Pose Preservationcited by 9
  20. 2022Learning from Label Relationships in Human Affectcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 16; 2025: 13; 2026: 7.

43 papers.

Sort:

By area:

  1. 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
  2. 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Facescited by 48
  3. 2023Diff-Privacy: Diffusion-based Face Privacy Protectioncited by 25
  4. 2024G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priorscited by 20
  5. 2024Face Anonymization Made Simplecited by 18
  6. 2024DiffusionAct: Controllable Diffusion Autoencoder for One-shot Face Reenactmentcited by 14
  7. 2024Are CLIP features all you need for Universal Synthetic Image Origin Attribution?cited by 14
  8. 2023Improving Fairness using Vision-Language Driven Image Augmentationcited by 13
  9. 2024Face De-identification: State-of-the-art Methods and Comparative Studiescited by 9
  10. 2024Latent Diffusion Models for Attribute-Preserving Image Anonymizationcited by 7
  11. 2024MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistancecited by 7
  12. 2024One-shot Neural Face Reenactment via Finding Directions in GAN's Latent Spacecited by 6
31 more
  1. 2024Privacy-preserving Optics for Enhancing Protection in Face De-identificationcited by 4
  2. 2025NullFace: Training-Free Localized Face Anonymizationcited by 4
  3. 2024Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verificationcited by 2
  4. 2026Now You See Me, Now You Don't: A Unified Framework for Expression Consistent Anonymization in Talking Head Videoscited by 2
  5. 2024Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generationcited by 1
  6. 2024For a semiotic AI: Bridging computer vision and visual semiotics for computational observation of large scale facial image archivescited by 1
  7. 2024A Key-Driven Framework for Identity-Preserving Face Anonymizationcited by 1
  8. 2025Generative Medical Image Anonymization Based on Latent Code Projection and Optimizationcited by 1
  9. 2025FaceAnonyMixer: Cancelable Faces via Identity Consistent Latent Space Mixingcited by 1
  10. 2025Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymizationcited by 1
  11. 2025Reverse Personalizationcited by 1
  12. 2023PrivacyGAN: robust generative image privacycited by 0
  13. 2023Disentangle Before Anonymize: A Two-stage Framework for Attribute-preserved and Occlusion-robust De-identificationcited by 0
  14. 2023Multi-Task Faces (MTF) Data Set: A Legally and Ethically Compliant Collection of Face Images for Various Classification Taskscited by 0
  15. 2023VerA: Versatile Anonymization Applicable to Clinical Facial Photographscited by 0
  16. 2024Toward Fairer Face Recognition Datasetscited by 0
  17. 2024Forbes: Face Obfuscation Rendering via Backpropagation Refinement Schemecited by 0
  18. 2025Computation-Efficient and Recognition-Friendly 3D Point Cloud Privacy Protectioncited by 0
  19. 2025Differentially Private 2D Human Pose Estimationcited by 0
  20. 2025Beyond Anonymization: Object Scrubbing for Privacy-Preserving 2D and 3D Vision Taskscited by 0
  21. 2025Facial Attribute Based Text Guided Face Anonymizationcited by 0
  22. 2025Controllable Localized Face Anonymization Via Diffusion Inpaintingcited by 0
  23. 2025Secure and reversible face anonymization with diffusion modelscited by 0
  24. 2025FLUID: Training-Free Face De-identification via Latent Identity Substitutioncited by 0
  25. 2025AEGIS: Preserving privacy of 3D Facial Avatars with Adversarial Perturbationscited by 0
  26. 2026StegaFFD: Privacy-Preserving Face Forgery Detection via Fine-Grained Steganographic Domain Liftingcited by 0
  27. 2026Face anonymization preserving facial expressions and photometric realismcited by 0
  28. 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMscited by 0
  29. 2026Face De-Identification: A Domain-Centric Survey from Capture to Processingcited by 0
  30. 2026Semantic Privacy Protection with Utility Preservation for 3D Point Cloudscited by 0
  31. 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approachcited by 0