LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognition
Not on the map. Why?
Abstract (arXiv)
Facial recognition systems are increasingly deployed by private corporations, government agencies, and contractors for consumer services and mass surveillance programs alike. These systems are typically built by scraping social media profiles for user images. Adversarial perturbations have been proposed for bypassing facial recognition systems. However, existing methods fail on full-scale systems and commercial APIs. We develop our own adversarial filter that accounts for the entire image processing pipeline and is demonstrably effective against industrial-grade pipelines that include face detection and large scale databases. Additionally, we release an easy-to-use webtool that significantly degrades the accuracy of Amazon Rekognition and the Microsoft Azure Face Recognition API, reducing the accuracy of each to below 1%.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 20 Jan 2021.
Builds on
18 of 32 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2016Adversarial examples in the physical worldcited by 1,762
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
- 2015The MegaFace Benchmark: 1 Million Faces for Recognition at Scalecited by 199
- 2019Making an Invisibility Cloak: Real World Adversarial Attacks on Object Detectorscited by 155
- 2020Perceptual Adversarial Robustness: Defense Against Unseen Threat Modelscited by 137
6 more
- 2020Towards Transferable Adversarial Attack against Deep Face Recognitioncited by 79
- 2016UMDFaces: An Annotated Face Dataset for Training Deep Networkscited by 42
- 2019Adversarial attacks on Copyright Detection Systemscited by 11
- 2020Adversarial Attacks on Machine Learning Systems for High-Frequency Tradingcited by 11
- 2019WITCHcraft: Efficient PGD attacks with random step sizecited by 4
- 2020A Method for Curation of Web-Scraped Face Image Datasetscited by 3
Built on by
Citing papers per year: 2021: 14; 2022: 11; 2023: 31; 2024: 15; 2025: 8; 2026: 13.
92 papers.
Sort:
By area:
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2021Adversarial Examples Make Strong Poisonscited by 115
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesiscited by 114
- 2022Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfercited by 77
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 72
- 2021Availability Attacks Create Shortcutscited by 60
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2021Data Poisoning Won't Save You From Facial Recognitioncited by 45
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 42
- 2023Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compressioncited by 39
- 2021Preventing Unauthorized Use of Proprietary Data: Poisoning for Secure Dataset Releasecited by 35
- 2022Unlearnable Clusters: Towards Label-agnostic Unlearnable Examplescited by 35
38 more
- 2023DiffProtect: Generate Adversarial Examples with Diffusion Models for Facial Privacy Protectioncited by 34
- 2022Indiscriminate Poisoning Attacks on Unsupervised Contrastive Learningcited by 32
- 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AIcited by 32
- 2024DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protectioncited by 31
- 2023Algorithmic Collective Action in Machine Learningcited by 30
- 2022Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognitioncited by 26
- 2022OPOM: Customized Invisible Cloak towards Face Privacy Protectioncited by 22
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesiscited by 21
- 2021Technical Challenges for Training Fair Neural Networkscited by 20
- 2023Towards Benchmarking and Assessing Visual Naturalness of Physical World Adversarial Attackscited by 18
- 2021SoK: Anti-Facial Recognition Technologycited by 16
- 2023The Best Defense is a Good Offense: Adversarial Augmentation against Adversarial Attackscited by 15
- 2024Geometry Cloak: Preventing TGS-based 3D Reconstruction from Copyrighted Imagescited by 15
- 2024Prompt-Agnostic Adversarial Perturbation for Customized Diffusion Modelscited by 14
- 2023Detection and Defense of Unlearnable Examplescited by 13
- 2021Am I a Real or Fake Celebrity? Measuring Commercial Face Recognition Web APIs under Deepfake Impersonation Attackcited by 12
- 2021Robustness Disparities in Commercial Face Detectioncited by 11
- 2024Talking Nonsense: Probing Large Language Models' Understanding of Adversarial Gibberish Inputscited by 11
- 2024Personalized Privacy Protection Mask Against Unauthorized Facial Recognitioncited by 10
- 2021Fairness Properties of Face Recognition and Obfuscation Systemscited by 9
- 2023Towards Prompt-robust Face Privacy Protection via Adversarial Decoupling Augmentation Frameworkcited by 9
- 2024Dormant: Defending against Pose-driven Human Image Animationcited by 9
- 2023Toward Face Biometric De-identification using Adversarial Examplescited by 8
- 2021Rethinking Image-Scaling Attacks: The Interplay Between Vulnerabilities in Machine Learning Systemscited by 7
- 2023Face Recognition in the age of CLIP & Billion image datasetscited by 7
- 2024Rethinking Impersonation and Dodging Attacks on Face Recognition Systemscited by 7
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priorscited by 7
- 2023Can Pretrained Language Models Derive Correct Semantics from Corrupt Subwords under Noise?cited by 6
- 2023Face Encryption via Frequency-Restricted Identity-Agnostic Attackscited by 6
- 2023Segue: Side-information Guided Generative Unlearnable Examples for Facial Privacy Protection in Real Worldcited by 6
- 2022Robustness Disparities in Face Detectioncited by 5
- 20233D-Aware Adversarial Makeup Generation for Facial Privacy Protectioncited by 5
- 2023Improving Visual Quality and Transferability of Adversarial Attacks on Face Recognition Simultaneously with Adversarial Restorationcited by 5
- 2023My Art My Choice: Adversarial Protection Against Unruly AIcited by 5
- 2023Adversarial Machine Learning for Social Good: Reframing the Adversary as an Allycited by 5
- 2025BlurGuard: A Simple Approach for Robustifying Image Protection Against AI-Powered Editingcited by 5
- 2021Identification of Attack-Specific Signatures in Adversarial Examplescited by 4
- 2021Preemptive Image Robustification for Protecting Users against Man-in-the-Middle Adversarial Attackscited by 4
50 most cited of 92 All 92 (JSON)
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle5 Aug 2026
- 2026Private Face Recognition Training Dataset Publication via Identity-Decoupled and Geometry-Preserving Face Distillation30 Jul 2026
- 2026Unlearnable Faces: Privacy Protection Surviving Extraction Pipeline7 Jul 2026
- 2026ChronoLock: Protecting Videos from Unauthorized Text-to-Video Personalization19 Jun 2026
- 2026Adv-TGD: Adversarial Text-Guided Diffusion for Face Recognition Impersonation Attacks10 Jun 2026
- 2026Personalized Face Privacy Protection From a Single Image18 May 2026
- 2026AuraMask: An Extensible Pipeline for Developing Aesthetic Anti-Facial Recognition Image Filters13 May 2026
- 2026Asymmetric Invertible Threat: Learning Reversible Privacy Defense for Face Recognition2 May 2026
- 2026Leave My Images Alone: Preventing Multi-Modal Large Language Models from Analyzing Images via Visual Prompt Injection10 Apr 2026
- 2026IDDM: Identity-Decoupled Personalized Diffusion Models with a Tunable Privacy-Utility Trade-off1 Apr 2026
- 2026Adversarial Camouflage23 Mar 2026
- 2026Purify Once, Edit Freely: Breaking Image Protections under Model Mismatch13 Mar 2026
38 more
- 2026How Professional Visual Artists are Negotiating Generative AI in the Workplace4 Mar 2026
- 2025AEGIS: Preserving privacy of 3D Facial Avatars with Adversarial Perturbations21 Nov 2025
- 2025BlurGuard: A Simple Approach for Robustifying Image Protection Against AI-Powered Editing31 Oct 2025
- 2025Investigating Adversarial Robustness against Preprocessing used in Blackbox Face Recognition20 Oct 2025
- 2025Explainable AI for Analyzing Person-Specific Patterns in Facial Recognition Tasks22 Sep 2025
- 2025Controllable Adversarial Makeup for Privacy via Text-Guided Diffusion13 Mar 2025
- 2025FairDeFace: Evaluating the Fairness and Adversarial Robustness of Face Obfuscation Methods11 Mar 2025
- 2025Towards Privacy-aware Mental Health AI Models: Advances, Challenges, and Opportunities1 Feb 2025
- 2025DivTrackee versus DynTracker: Promoting Diversity in Anti-Facial Recognition against Dynamic FR Strategy11 Jan 2025
- 2024Improving the Transferability of Adversarial Attacks on Face Recognition with Diverse Parameters Augmentation23 Nov 2024
- 2024Geometry Cloak: Preventing TGS-based 3D Reconstruction from Copyrighted Images30 Oct 2024
- 2024Proactive Schemes: A Survey of Adversarial Attacks for Social Good24 Sep 2024
- 2024Dormant: Defending against Pose-driven Human Image Animation22 Sep 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
- 2024Prompt-Agnostic Adversarial Perturbation for Customized Diffusion Models20 Aug 2024
- 2024Personalized Privacy Protection Mask Against Unauthorized Facial Recognition19 Jul 2024
- 2024Principles of Designing Robust Remote Face Anti-Spoofing Systems6 Jun 2024
- 2024PuFace: Defending against Facial Cloaking Attacks for Facial Recognition Models4 Jun 2024
- 2024Adversarial Attacks on Both Face Recognition and Face Anti-spoofing Models27 May 2024
- 2024DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protection16 May 2024
- 2024Talking Nonsense: Probing Large Language Models' Understanding of Adversarial Gibberish Inputs26 Apr 2024
- 2024Rethinking Impersonation and Dodging Attacks on Face Recognition Systems17 Jan 2024
- 2024Crafter: Facial Feature Crafting against Inversion-based Identity Theft on Deep Models14 Jan 2024
- 2024Enhancing Generalization of Invisible Facial Privacy Cloak via Gradient Accumulation3 Jan 2024
- 2023CamPro: Camera-based Anti-Facial Recognition30 Dec 2023
- 2023Online Algorithmic Recourse by Collective Action29 Dec 2023
- 2023AdvCloak: Customized Adversarial Cloak for Privacy Protection22 Dec 2023
- 2023The Ultimate Combo: Boosting Adversarial Example Transferability by Composing Data Augmentations18 Dec 2023
- 2023Detection and Defense of Unlearnable Examples14 Dec 2023
- 2023NeRFTAP: Enhancing Transferability of Adversarial Patches on Face Recognition using Neural Radiance Fields29 Nov 2023
- 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AI30 Oct 2023
- 2023Segue: Side-information Guided Generative Unlearnable Examples for Facial Privacy Protection in Real World24 Oct 2023
- 2023Facial Data Minimization: Shallow Model as Your Privacy Filter24 Oct 2023
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models20 Oct 2023
- 2023PrivacyGAN: robust generative image privacy19 Oct 2023
- 2023Adversarial Machine Learning for Social Good: Reframing the Adversary as an Ally5 Oct 2023
- 2023My Art My Choice: Adversarial Protection Against Unruly AI6 Sep 2023
- 2023Improving Visual Quality and Transferability of Adversarial Attacks on Face Recognition Simultaneously with Adversarial Restoration4 Sep 2023
50 newest of 92 All 92 (JSON)
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 200
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesiscited by 114
- 2023DiffProtect: Generate Adversarial Examples with Diffusion Models for Facial Privacy Protectioncited by 34
- 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AIcited by 32
- 2024DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protectioncited by 31
- 2024Prompt-Agnostic Adversarial Perturbation for Customized Diffusion Modelscited by 14
- 2023Towards Prompt-robust Face Privacy Protection via Adversarial Decoupling Augmentation Frameworkcited by 9
- 2023My Art My Choice: Adversarial Protection Against Unruly AIcited by 5
- 2026Purify Once, Edit Freely: Breaking Image Protections under Model Mismatchcited by 1
- 2026IDDM: Identity-Decoupled Personalized Diffusion Models with a Tunable Privacy-Utility Trade-offcited by 1
- 2026Adv-TGD: Adversarial Text-Guided Diffusion for Face Recognition Impersonation Attackscited by 1
- 2025Controllable Adversarial Makeup for Privacy via Text-Guided Diffusioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026ChronoLock: Protecting Videos from Unauthorized Text-to-Video Personalization19 Jun 2026
- 2026Adv-TGD: Adversarial Text-Guided Diffusion for Face Recognition Impersonation Attacks10 Jun 2026
- 2026IDDM: Identity-Decoupled Personalized Diffusion Models with a Tunable Privacy-Utility Trade-off1 Apr 2026
- 2026Purify Once, Edit Freely: Breaking Image Protections under Model Mismatch13 Mar 2026
- 2025Controllable Adversarial Makeup for Privacy via Text-Guided Diffusion13 Mar 2025
- 2024Prompt-Agnostic Adversarial Perturbation for Customized Diffusion Models20 Aug 2024
- 2024DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protection16 May 2024
- 2023IMPRESS: Evaluating the Resilience of Imperceptible Perturbations Against Unauthorized Data Usage in Diffusion-Based Generative AI30 Oct 2023
- 2023My Art My Choice: Adversarial Protection Against Unruly AI6 Sep 2023
- 2023DiffProtect: Generate Adversarial Examples with Diffusion Models for Facial Privacy Protection23 May 2023
- 2023Towards Prompt-robust Face Privacy Protection via Adversarial Decoupling Augmentation Framework6 May 2023
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesis27 Mar 2023
12 newest of 13 All 13 (JSON)
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 72
- 2021Data Poisoning Won't Save You From Facial Recognitioncited by 45
- 2022Indiscriminate Poisoning Attacks on Unsupervised Contrastive Learningcited by 32
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesiscited by 21
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models20 Oct 2023
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesis13 Jun 2023
- 2022Indiscriminate Poisoning Attacks on Unsupervised Contrastive Learning22 Feb 2022
- 2021Data Poisoning Won't Save You From Facial Recognition28 Jun 2021
- 2021Adversarial Examples Make Strong Poisonscited by 115
- 2022Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfercited by 77
- 2021Availability Attacks Create Shortcutscited by 60
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 42
- 2023Image Shortcut Squeezing: Countering Perturbative Availability Poisons with Compressioncited by 39
- 2021Preventing Unauthorized Use of Proprietary Data: Poisoning for Secure Dataset Releasecited by 35
- 2022Unlearnable Clusters: Towards Label-agnostic Unlearnable Examplescited by 35
- 2023Algorithmic Collective Action in Machine Learningcited by 30
- 2022Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognitioncited by 26
- 2022OPOM: Customized Invisible Cloak towards Face Privacy Protectioncited by 22
- 2021Technical Challenges for Training Fair Neural Networkscited by 20
12 most cited of 74 All 74 (JSON)
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle5 Aug 2026
- 2026Private Face Recognition Training Dataset Publication via Identity-Decoupled and Geometry-Preserving Face Distillation30 Jul 2026
- 2026Unlearnable Faces: Privacy Protection Surviving Extraction Pipeline7 Jul 2026
- 2026Personalized Face Privacy Protection From a Single Image18 May 2026
- 2026AuraMask: An Extensible Pipeline for Developing Aesthetic Anti-Facial Recognition Image Filters13 May 2026
- 2026Asymmetric Invertible Threat: Learning Reversible Privacy Defense for Face Recognition2 May 2026
- 2026Adversarial Camouflage23 Mar 2026
- 2026How Professional Visual Artists are Negotiating Generative AI in the Workplace4 Mar 2026
- 2025AEGIS: Preserving privacy of 3D Facial Avatars with Adversarial Perturbations21 Nov 2025
- 2025BlurGuard: A Simple Approach for Robustifying Image Protection Against AI-Powered Editing31 Oct 2025
- 2025Investigating Adversarial Robustness against Preprocessing used in Blackbox Face Recognition20 Oct 2025
- 2025Explainable AI for Analyzing Person-Specific Patterns in Facial Recognition Tasks22 Sep 2025
12 newest of 74 All 74 (JSON)