Dodging Attack Using Carefully Crafted Natural Makeup
Not on the map. Why?
Abstract (arXiv)
Deep learning face recognition models are used by state-of-the-art surveillance systems to identify individuals passing through public areas (e.g., airports). Previous studies have demonstrated the use of adversarial machine learning (AML) attacks to successfully evade identification by such systems, both in the digital and physical domains. Attacks in the physical domain, however, require significant manipulation to the human participant's face, which can raise suspicion by human observers (e.g. airport security officers). In this study, we present a novel black-box AML attack which carefully crafts natural makeup, which, when applied on a human participant, prevents the participant from being identified by facial recognition models. We evaluated our proposed attack against the ArcFace face recognition model, with 20 participants in a real-world setup that includes two cameras, different shooting angles, and different lighting conditions. The evaluation results show that in the digital domain, the face recognition system was unable to identify all of the participants, while in the physical domain, the face recognition system was able to identify the participants in only 1.22% of the frames (compared to 47.57% without makeup and 33.73% with random natural makeup), which is below a reasonable threshold of a realistic operational environment.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 14 Sep 2021.
Builds on
21 of 37 references.
References · 21
- 2013Intriguing properties of neural networkscited by 5,155
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 737
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 624
- 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 460
- 2014Learning Face Representation from Scratchcited by 453
- 2016Large-Margin Softmax Loss for Convolutional Neural Networkscited by 296
- 2018Additive Margin Softmax for Face Verificationcited by 278
- 2019Fooling automated surveillance cameras: adversarial patches to attack person detectioncited by 268
- 2019Efficient Decision-based Black-box Adversarial Attacks on Face Recognitioncited by 175
9 more
- 2019AdvHat: Real-world adversarial attack on ArcFace Face ID systemcited by 163
- 2014Deep Learning Face Representation by Joint Identification-Verificationcited by 162
- 2021Adv-Makeup: A New Imperceptible and Transferable Attack on Face Recognitioncited by 97
- 2017A General Framework for Adversarial Examples with Objectivescited by 84
- 2019AdvFaces: Adversarial Face Synthesiscited by 60
- 2015From Facial Parts Responses to Face Detection: A Deep Learning Approachcited by 42
- 2018Attacks on State-of-the-Art Face Recognition using Attentional Adversarial Attack Generative Networkcited by 38
- 2019Amora: Black-box Adversarial Morphing Attackcited by 17
- 2014Face Recognition Methods & Applicationscited by 11
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 6; 2024: 3; 2025: 2; 2026: 2.
17 papers.
Sort:
- 2022The Fallacy of AI Functionalitycited by 88
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 43
- 2022Evidence for Hypodescent in Visual Semantic AIcited by 30
- 2022Markedness in Visual Semantic AIcited by 29
- 2021Adversarial Mask: Real-World Universal Adversarial Attack on Face Recognition Modelcited by 19
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priorscited by 8
- 2024Transferable Adversarial Face Attack with Text Controlled Attributecited by 5
- 2023Stealthy Physical Masked Face Recognition Attack via Adversarial Style Optimizationcited by 4
- 2024A Survey on Physical Adversarial Attacks against Face Recognition Systemscited by 4
- 2023Hindering Adversarial Attacks with Multiple Encrypted Patch Embeddingscited by 2
- 2023Semantic Adversarial Attacks on Face Recognition through Significant Attributescited by 1
- 2023Efficient Key-Based Adversarial Defense for ImageNet by Using Pre-trained Modelcited by 1
5 more
- 2025Explainable AI for Analyzing Person-Specific Patterns in Facial Recognition Taskscited by 1
- 2023Simultaneous Adversarial Attacks On Multiple Face Recognition System Componentscited by 0
- 2025A Privacy Enhancing Technique to Evade Detection by Street Video Cameras Without Using Adversarial Accessoriescited by 0
- 2026Noise-Aware Misclassification Attack Detection in Collaborative DNN Inferencecited by 0
- 2026Adversarial Camouflagecited by 0
- 2026Adversarial Camouflage23 Mar 2026
- 2026Noise-Aware Misclassification Attack Detection in Collaborative DNN Inference18 Mar 2026
- 2025Explainable AI for Analyzing Person-Specific Patterns in Facial Recognition Tasks22 Sep 2025
- 2025A Privacy Enhancing Technique to Evade Detection by Street Video Cameras Without Using Adversarial Accessories26 Jan 2025
- 2024Transferable Adversarial Face Attack with Text Controlled Attribute16 Dec 2024
- 2024A Survey on Physical Adversarial Attacks against Face Recognition Systems10 Oct 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
- 2023Efficient Key-Based Adversarial Defense for ImageNet by Using Pre-trained Model28 Nov 2023
- 2023Stealthy Physical Masked Face Recognition Attack via Adversarial Style Optimization18 Sep 2023
- 2023Hindering Adversarial Attacks with Multiple Encrypted Patch Embeddings4 Sep 2023
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Search16 Jun 2023
- 2023Simultaneous Adversarial Attacks On Multiple Face Recognition System Components11 Apr 2023
5 more
- 2023Semantic Adversarial Attacks on Face Recognition through Significant Attributes28 Jan 2023
- 2022The Fallacy of AI Functionality20 Jun 2022
- 2022Markedness in Visual Semantic AI23 May 2022
- 2022Evidence for Hypodescent in Visual Semantic AI22 May 2022
- 2021Adversarial Mask: Real-World Universal Adversarial Attack on Face Recognition Model21 Nov 2021
- 2022The Fallacy of AI Functionalitycited by 88
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 43
- 2022Evidence for Hypodescent in Visual Semantic AIcited by 30
- 2022Markedness in Visual Semantic AIcited by 29
- 2021Adversarial Mask: Real-World Universal Adversarial Attack on Face Recognition Modelcited by 19
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priorscited by 8
- 2024Transferable Adversarial Face Attack with Text Controlled Attributecited by 5
- 2023Stealthy Physical Masked Face Recognition Attack via Adversarial Style Optimizationcited by 4
- 2024A Survey on Physical Adversarial Attacks against Face Recognition Systemscited by 4
- 2023Hindering Adversarial Attacks with Multiple Encrypted Patch Embeddingscited by 2
- 2023Semantic Adversarial Attacks on Face Recognition through Significant Attributescited by 1
- 2023Efficient Key-Based Adversarial Defense for ImageNet by Using Pre-trained Modelcited by 1
12 most cited of 17 All 17 (JSON)
- 2026Adversarial Camouflage23 Mar 2026
- 2026Noise-Aware Misclassification Attack Detection in Collaborative DNN Inference18 Mar 2026
- 2025Explainable AI for Analyzing Person-Specific Patterns in Facial Recognition Tasks22 Sep 2025
- 2025A Privacy Enhancing Technique to Evade Detection by Street Video Cameras Without Using Adversarial Accessories26 Jan 2025
- 2024Transferable Adversarial Face Attack with Text Controlled Attribute16 Dec 2024
- 2024A Survey on Physical Adversarial Attacks against Face Recognition Systems10 Oct 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
- 2023Efficient Key-Based Adversarial Defense for ImageNet by Using Pre-trained Model28 Nov 2023
- 2023Stealthy Physical Masked Face Recognition Attack via Adversarial Style Optimization18 Sep 2023
- 2023Hindering Adversarial Attacks with Multiple Encrypted Patch Embeddings4 Sep 2023
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Search16 Jun 2023
- 2023Simultaneous Adversarial Attacks On Multiple Face Recognition System Components11 Apr 2023
12 newest of 17 All 17 (JSON)