Face Encryption via Frequency-Restricted Identity-Agnostic Attacks
Not on the map. Why?
Abstract (arXiv)
Billions of people are sharing their daily live images on social media everyday. However, malicious collectors use deep face recognition systems to easily steal their biometric information (e.g., faces) from these images. Some studies are being conducted to generate encrypted face photos using adversarial attacks by introducing imperceptible perturbations to reduce face information leakage. However, existing studies need stronger black-box scenario feasibility and more natural visual appearances, which challenge the feasibility of privacy protection. To address these problems, we propose a frequency-restricted identity-agnostic (FRIA) framework to encrypt face images from unauthorized face recognition without access to personal information. As for the weak black-box scenario feasibility, we obverse that representations of the average feature in multiple face recognition models are similar, thus we propose to utilize the average feature via the crawled dataset from the Internet as the target to guide the generation, which is also agnostic to identities of unknown face recognition systems; in nature, the low-frequency perturbations are more visually perceptible by the human vision system. Inspired by this, we restrict the perturbation in the low-frequency facial regions by discrete cosine transform to achieve the visual naturalness guarantee. Extensive experiments on several face recognition models demonstrate that our FRIA outperforms other state-of-the-art methods in generating more natural encrypted faces while attaining high black-box attack success rates of 96%. In addition, we validate the efficacy of FRIA using real-world black-box commercial API, which reveals the potential of FRIA in practice. Our codes can be found in https://github.com/XinDong10/FRIA.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 43 of its 64 references that are in the map. First posted on arXiv 11 Aug 2023.
Builds on
43 of 64 references.
References · 43
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2013Intriguing properties of neural networkscited by 5,155
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
- 2016Adversarial Machine Learning at Scalecited by 936
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 737
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 599
31 more
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
- 2018Additive Margin Softmax for Face Verificationcited by 278
- 2019Fooling automated surveillance cameras: adversarial patches to attack person detectioncited by 268
- 2019Adversarial Attacks and Defenses in Images, Graphs and Text: A Reviewcited by 237
- 2015The MegaFace Benchmark: 1 Million Faces for Recognition at Scalecited by 200
- 2018MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devicescited by 182
- 2020A Self-supervised Approach for Adversarial Robustnesscited by 180
- 2019Making an Invisibility Cloak: Real World Adversarial Attacks on Object Detectorscited by 155
- 2021Dual Attention Suppression Attack: Generate Adversarial Camouflage in Physical Worldcited by 127
- 2018Transferable Adversarial Attacks for Image and Video Object Detectioncited by 109
- 2021LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognitioncited by 94
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2022Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfercited by 78
- 2022Frequency-driven Imperceptible Adversarial Attack on Semantic Similaritycited by 77
- 2020Efficient Adversarial Attacks for Visual Object Trackingcited by 66
- 2020Towards Face Encryption by Generating Adversarial Identity Maskscited by 63
- 2019Training Robust Deep Neural Networks via Adversarial Noise Propagationcited by 62
- 2017Natural and Effective Obfuscation by Head Inpaintingcited by 60
- 2023X-Adv: Physical Adversarial Object Attacks against X-ray Prohibited Item Detectioncited by 59
- 2019On the Effectiveness of Low Frequency Perturbationscited by 56
- 2022A Large-scale Multiple-objective Method for Black-box Attack against Object Detectioncited by 55
- 2019AnonymousNet: Natural Face De-Identification with Measurable Privacycited by 50
- 2016Defeating Image Obfuscation with Deep Learningcited by 43
- 2018A Hybrid Model for Identity Obfuscation by Face Replacementcited by 43
- 2021Harnessing Perceptual Adversarial Patches for Crowd Countingcited by 39
- 2023Towards Effective Adversarial Textured 3D Meshes on Physical Face Recognitioncited by 33
- 2016Faceless Person Recognition; Privacy Implications in Social Mediacited by 27
- 2018Privacy-Protective-GAN for Face De-identificationcited by 14
- 2020RobFR: Benchmarking Adversarial Robustness on Face Recognitioncited by 10
- 2021Perceptually Constrained Adversarial Attackscited by 7
Built on by
Citing papers per year: 2024: 4; 2025: 1; 2026: 1.
6 papers.
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearningcited by 31
- 2024Compromising Embodied Agents with Contextual Backdoor Attackscited by 31
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threatscited by 6
- 2025GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbationscited by 5
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysiscited by 4
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2025GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbations5 Aug 2025
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threats29 Sep 2024
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysis24 Sep 2024
- 2024Compromising Embodied Agents with Contextual Backdoor Attacks6 Aug 2024
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearning24 Mar 2024