Attribute-preserving Face Dataset Anonymization via Latent Code Optimization
Not on the map. Why?
Abstract (arXiv)
This work addresses the problem of anonymizing the identity of faces in a dataset of images, such that the privacy of those depicted is not violated, while at the same time the dataset is useful for downstream task such as for training machine learning models. To the best of our knowledge, we are the first to explicitly address this issue and deal with two major drawbacks of the existing state-of-the-art approaches, namely that they (i) require the costly training of additional, purpose-trained neural networks, and/or (ii) fail to retain the facial attributes of the original images in the anonymized counterparts, the preservation of which is of paramount importance for their use in downstream tasks. We accordingly present a task-agnostic anonymization procedure that directly optimizes the images' latent representation in the latent space of a pre-trained GAN. By optimizing the latent codes directly, we ensure both that the identity is of a desired distance away from the original (with an identity obfuscation loss), whilst preserving the facial attributes (using a novel feature-matching loss in FaRL's deep feature space). We demonstrate through a series of both qualitative and quantitative experiments that our method is capable of anonymizing the identity of the images whilst -- crucially -- better-preserving the facial attributes. We make the code and the pre-trained models publicly available at: https://github.com/chi0tzp/FALCO.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 20 Mar 2023.
Builds on
32 of 49 references.
References · 32
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2014Learning Face Representation from Scratchcited by 451
20 more
- 2018Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyondcited by 216
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 193
- 2019DeepPrivacy: A Generative Adversarial Network for Face Anonymizationcited by 108
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2020CIAGAN: Conditional Identity Anonymization Generative Adversarial Networkscited by 88
- 2021Anycost GANs for Interactive Image Synthesis and Editingcited by 54
- 2019AnonymousNet: Natural Face De-Identification with Measurable Privacycited by 50
- 2021WarpedGANSpace: Finding non-linear RBF paths in GAN latent spacecited by 48
- 2016Defeating Image Obfuscation with Deep Learningcited by 43
- 2016Faceless Person Recognition; Privacy Implications in Social Mediacited by 27
- 2021IdentityDP: Differential Private Identification Protection for Face Imagescited by 24
- 2022PandA: Unsupervised Learning of Parts and Appearances in the Feature Maps of GANscited by 20
- 2022StyleMask: Disentangling the Style Space of StyleGAN2 for Neural Face Reenactmentcited by 17
- 2018SchiNet: Automatic Estimation of Symptoms of Schizophrenia from Facial Behaviour Analysiscited by 16
- 2018Privacy-Protective-GAN for Face De-identificationcited by 14
- 2021Tensor Component Analysis for Interpreting the Latent Space of GANscited by 13
- 2021CFA-Net: Controllable Face Anonymization Network with Identity Representation Manipulationcited by 12
- 2022ContraCLIP: Interpretable GAN generation driven by pairs of contrasting sentencescited by 12
- 2021Graph-based Generative Face Anonymisation with Pose Preservationcited by 9
- 2022Learning from Label Relationships in Human Affectcited by 8
Built on by
Citing papers per year: 2023: 7; 2024: 16; 2025: 13; 2026: 7.
43 papers.
Sort:
By area:
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Facescited by 48
- 2023Diff-Privacy: Diffusion-based Face Privacy Protectioncited by 25
- 2024G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priorscited by 20
- 2024Face Anonymization Made Simplecited by 18
- 2024DiffusionAct: Controllable Diffusion Autoencoder for One-shot Face Reenactmentcited by 14
- 2024Are CLIP features all you need for Universal Synthetic Image Origin Attribution?cited by 14
- 2023Improving Fairness using Vision-Language Driven Image Augmentationcited by 13
- 2024Face De-identification: State-of-the-art Methods and Comparative Studiescited by 9
- 2024Latent Diffusion Models for Attribute-Preserving Image Anonymizationcited by 7
- 2024MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistancecited by 7
- 2024One-shot Neural Face Reenactment via Finding Directions in GAN's Latent Spacecited by 6
31 more
- 2024Privacy-preserving Optics for Enhancing Protection in Face De-identificationcited by 4
- 2025NullFace: Training-Free Localized Face Anonymizationcited by 4
- 2024Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verificationcited by 2
- 2026Now You See Me, Now You Don't: A Unified Framework for Expression Consistent Anonymization in Talking Head Videoscited by 2
- 2024Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generationcited by 1
- 2024For a semiotic AI: Bridging computer vision and visual semiotics for computational observation of large scale facial image archivescited by 1
- 2024A Key-Driven Framework for Identity-Preserving Face Anonymizationcited by 1
- 2025Generative Medical Image Anonymization Based on Latent Code Projection and Optimizationcited by 1
- 2025FaceAnonyMixer: Cancelable Faces via Identity Consistent Latent Space Mixingcited by 1
- 2025Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymizationcited by 1
- 2025Reverse Personalizationcited by 1
- 2023PrivacyGAN: robust generative image privacycited by 0
- 2023Disentangle Before Anonymize: A Two-stage Framework for Attribute-preserved and Occlusion-robust De-identificationcited by 0
- 2023Multi-Task Faces (MTF) Data Set: A Legally and Ethically Compliant Collection of Face Images for Various Classification Taskscited by 0
- 2023VerA: Versatile Anonymization Applicable to Clinical Facial Photographscited by 0
- 2024Toward Fairer Face Recognition Datasetscited by 0
- 2024Forbes: Face Obfuscation Rendering via Backpropagation Refinement Schemecited by 0
- 2025Computation-Efficient and Recognition-Friendly 3D Point Cloud Privacy Protectioncited by 0
- 2025Differentially Private 2D Human Pose Estimationcited by 0
- 2025Beyond Anonymization: Object Scrubbing for Privacy-Preserving 2D and 3D Vision Taskscited by 0
- 2025Facial Attribute Based Text Guided Face Anonymizationcited by 0
- 2025Controllable Localized Face Anonymization Via Diffusion Inpaintingcited by 0
- 2025Secure and reversible face anonymization with diffusion modelscited by 0
- 2025FLUID: Training-Free Face De-identification via Latent Identity Substitutioncited by 0
- 2025AEGIS: Preserving privacy of 3D Facial Avatars with Adversarial Perturbationscited by 0
- 2026StegaFFD: Privacy-Preserving Face Forgery Detection via Fine-Grained Steganographic Domain Liftingcited by 0
- 2026Face anonymization preserving facial expressions and photometric realismcited by 0
- 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMscited by 0
- 2026Face De-Identification: A Domain-Centric Survey from Capture to Processingcited by 0
- 2026Semantic Privacy Protection with Utility Preservation for 3D Point Cloudscited by 0
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approachcited by 0
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026Semantic Privacy Protection with Utility Preservation for 3D Point Clouds12 Sep 2026
- 2026Face De-Identification: A Domain-Centric Survey from Capture to Processing28 Jul 2026
- 2026Seeing Without Exposing: Adaptive Privacy Control for Open-World, Context-Hungry MLLMs5 Jun 2026
- 2026Face anonymization preserving facial expressions and photometric realism18 Mar 2026
- 2026StegaFFD: Privacy-Preserving Face Forgery Detection via Fine-Grained Steganographic Domain Lifting3 Mar 2026
- 2026Now You See Me, Now You Don't: A Unified Framework for Expression Consistent Anonymization in Talking Head Videos14 Jan 2026
- 2025Reverse Personalization28 Dec 2025
- 2025AEGIS: Preserving privacy of 3D Facial Avatars with Adversarial Perturbations21 Nov 2025
- 2025FLUID: Training-Free Face De-identification via Latent Identity Substitution21 Nov 2025
- 2025Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymization28 Oct 2025
- 2025Secure and reversible face anonymization with diffusion models1 Oct 2025
31 more
- 2025Controllable Localized Face Anonymization Via Diffusion Inpainting18 Sep 2025
- 2025FaceAnonyMixer: Cancelable Faces via Identity Consistent Latent Space Mixing7 Aug 2025
- 2025Facial Attribute Based Text Guided Face Anonymization27 May 2025
- 2025Beyond Anonymization: Object Scrubbing for Privacy-Preserving 2D and 3D Vision Tasks23 Apr 2025
- 2025Differentially Private 2D Human Pose Estimation14 Apr 2025
- 2025Computation-Efficient and Recognition-Friendly 3D Point Cloud Privacy Protection20 Mar 2025
- 2025NullFace: Training-Free Localized Face Anonymization11 Mar 2025
- 2025Generative Medical Image Anonymization Based on Latent Code Projection and Optimization15 Jan 2025
- 2024Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verification4 Dec 2024
- 2024Face De-identification: State-of-the-art Methods and Comparative Studies15 Nov 2024
- 2024Face Anonymization Made Simple1 Nov 2024
- 2024MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistance17 Sep 2024
- 2024A Key-Driven Framework for Identity-Preserving Face Anonymization5 Sep 2024
- 2024G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors18 Aug 2024
- 2024Are CLIP features all you need for Universal Synthetic Image Origin Attribution?17 Aug 2024
- 2024Forbes: Face Obfuscation Rendering via Backpropagation Refinement Scheme19 Jul 2024
- 2024For a semiotic AI: Bridging computer vision and visual semiotics for computational observation of large scale facial image archives3 Jul 2024
- 2024Toward Fairer Face Recognition Datasets24 Jun 2024
- 2024Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generation27 May 2024
- 2024Privacy-preserving Optics for Enhancing Protection in Face De-identification31 Mar 2024
- 2024Deepfake Generation and Detection: A Benchmark and Survey26 Mar 2024
- 2024DiffusionAct: Controllable Diffusion Autoencoder for One-shot Face Reenactment25 Mar 2024
- 2024Latent Diffusion Models for Attribute-Preserving Image Anonymization21 Mar 2024
- 2024One-shot Neural Face Reenactment via Finding Directions in GAN's Latent Space5 Feb 2024
- 2023VerA: Versatile Anonymization Applicable to Clinical Facial Photographs4 Dec 2023
- 2023Multi-Task Faces (MTF) Data Set: A Legally and Ethically Compliant Collection of Face Images for Various Classification Tasks20 Nov 2023
- 2023Disentangle Before Anonymize: A Two-stage Framework for Attribute-preserved and Occlusion-robust De-identification15 Nov 2023
- 2023Improving Fairness using Vision-Language Driven Image Augmentation2 Nov 2023
- 2023PrivacyGAN: robust generative image privacy19 Oct 2023
- 2023Diff-Privacy: Diffusion-based Face Privacy Protection11 Sep 2023
- 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Faces20 Jul 2023
- 2024DiffusionAct: Controllable Diffusion Autoencoder for One-shot Face Reenactmentcited by 14
- 2024Are CLIP features all you need for Universal Synthetic Image Origin Attribution?cited by 14
- 2024Latent Diffusion Models for Attribute-Preserving Image Anonymizationcited by 7
- 2024Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generationcited by 1
- 2025Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymizationcited by 1
- 2025Reverse Personalizationcited by 1
- 2025Secure and reversible face anonymization with diffusion modelscited by 0
- 2025FLUID: Training-Free Face De-identification via Latent Identity Substitutioncited by 0
- 2025Reverse Personalization28 Dec 2025
- 2025FLUID: Training-Free Face De-identification via Latent Identity Substitution21 Nov 2025
- 2025Beyond Inference Intervention: Identity-Decoupled Diffusion for Face Anonymization28 Oct 2025
- 2025Secure and reversible face anonymization with diffusion models1 Oct 2025
- 2024Are CLIP features all you need for Universal Synthetic Image Origin Attribution?17 Aug 2024
- 2024Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generation27 May 2024
- 2024DiffusionAct: Controllable Diffusion Autoencoder for One-shot Face Reenactment25 Mar 2024
- 2024Latent Diffusion Models for Attribute-Preserving Image Anonymization21 Mar 2024
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2023HyperReenact: One-Shot Reenactment via Jointly Learning to Refine and Retarget Facescited by 48
- 2023Diff-Privacy: Diffusion-based Face Privacy Protectioncited by 25
- 2024G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priorscited by 20
- 2024Face Anonymization Made Simplecited by 18
- 2023Improving Fairness using Vision-Language Driven Image Augmentationcited by 13
- 2024Face De-identification: State-of-the-art Methods and Comparative Studiescited by 9
- 2024MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistancecited by 7
- 2024One-shot Neural Face Reenactment via Finding Directions in GAN's Latent Spacecited by 6
- 2024Privacy-preserving Optics for Enhancing Protection in Face De-identificationcited by 4
- 2025NullFace: Training-Free Localized Face Anonymizationcited by 4
- 2024Fairer Analysis and Demographically Balanced Face Generation for Fairer Face Verificationcited by 2
12 most cited of 34 All 34 (JSON)
- 2026HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach22 Sep 2026
- 2026Semantic Privacy Protection with Utility Preservation for 3D Point Clouds12 Sep 2026
- 2026Face De-Identification: A Domain-Centric Survey from Capture to Processing28 Jul 2026
- 2026Face anonymization preserving facial expressions and photometric realism18 Mar 2026
- 2026StegaFFD: Privacy-Preserving Face Forgery Detection via Fine-Grained Steganographic Domain Lifting3 Mar 2026
- 2026Now You See Me, Now You Don't: A Unified Framework for Expression Consistent Anonymization in Talking Head Videos14 Jan 2026
- 2025AEGIS: Preserving privacy of 3D Facial Avatars with Adversarial Perturbations21 Nov 2025
- 2025Controllable Localized Face Anonymization Via Diffusion Inpainting18 Sep 2025
- 2025FaceAnonyMixer: Cancelable Faces via Identity Consistent Latent Space Mixing7 Aug 2025
- 2025Facial Attribute Based Text Guided Face Anonymization27 May 2025
- 2025Beyond Anonymization: Object Scrubbing for Privacy-Preserving 2D and 3D Vision Tasks23 Apr 2025
- 2025Differentially Private 2D Human Pose Estimation14 Apr 2025
12 newest of 34 All 34 (JSON)