mlsanityData to 14 Oct 2026

Facial Data Minimization: Shallow Model as Your Privacy Filter

arXiv 2310.15590 ↗First posted 24 Oct 2023cs.CR cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Face recognition service has been used in many fields and brings much convenience to people. However, once the user's facial data is transmitted to a service provider, the user will lose control of his/her private data. In recent years, there exist various security and privacy issues due to the leakage of facial data. Although many privacy-preserving methods have been proposed, they usually fail when they are not accessible to adversaries' strategies or auxiliary data. Hence, in this paper, by fully considering two cases of uploading facial images and facial features, which are very typical in face recognition service systems, we proposed a data privacy minimization transformation (PMT) method. This method can process the original facial data based on the shallow model of authorized services to obtain the obfuscated data. The obfuscated data can not only maintain satisfactory performance on authorized models and restrict the performance on other unauthorized models but also prevent original privacy data from leaking by AI methods and human visual theft. Additionally, since a service provider may execute preprocessing operations on the received data, we also propose an enhanced perturbation method to improve the robustness of PMT. Besides, to authorize one facial image to multiple service models simultaneously, a multiple restriction mechanism is proposed to improve the scalability of PMT. Finally, we conduct extensive experiments and evaluate the effectiveness of the proposed PMT in defending against face reconstruction, data abuse, and face attribute estimation attacks. These experimental results demonstrate that PMT performs well in preventing facial data abuse and privacy leakage while maintaining face recognition accuracy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 47 of its 71 references that are in the map. First posted on arXiv 24 Oct 2023.

Builds on

47 of 71 references.

References · 47

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  5. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  6. 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
  7. 2016Practical Black-Box Attacks against Machine Learningcited by 903
  8. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  9. 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 737
  10. 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
  11. 2014Learning Face Representation from Scratchcited by 453
  12. 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
35 more
  1. 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 355
  2. 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 292
  3. 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 260
  4. 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 246
  5. 2018MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devicescited by 182
  6. 2015Inverting Visual Representations with Convolutional Networkscited by 170
  7. 2018PRADA: Protecting against DNN Model Stealing Attackscited by 165
  8. 2019Enhancing Adversarial Example Transferability with an Intermediate Level Attackcited by 140
  9. 2021Feature Importance-aware Transferable Adversarial Attackscited by 127
  10. 2021SynFace: Face Recognition with Synthetic Datacited by 106
  11. 2021LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognitioncited by 94
  12. 2018JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Servicescited by 80
  13. 2022Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfercited by 78
  14. 2017On the Reconstruction of Face Images from Deep Face Templatescited by 67
  15. 2020Knowledge-Enriched Distributional Model Inversion Attackscited by 67
  16. 2020Towards Face Encryption by Generating Adversarial Identity Maskscited by 63
  17. 2022Plug & Play Attacks: Towards Robust and Flexible Model Inversion Attackscited by 60
  18. 2021UnSplit: Data-Oblivious Model Inversion, Model Stealing, and Label Inference Attacks Against Split Learningcited by 52
  19. 2021Data Poisoning Won't Save You From Facial Recognitioncited by 45
  20. 2017Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approachcited by 43
  21. 2018Understanding and Enhancing the Transferability of Adversarial Examplescited by 41
  22. 2023Physically Adversarial Infrared Patches with Learnable Shapes and Locationscited by 39
  23. 2019Adversarial Learning of Privacy-Preserving and Task-Oriented Representationscited by 36
  24. 2018Edge-Host Partitioning of Deep Neural Networks with Feature Space Encoding for Resource-Constrained Internet-of-Things Platformscited by 35
  25. 2020Privacy Preserving Face Recognition Utilizing Differential Privacycited by 30
  26. 2020Face-Off: Adversarial Face Obfuscationcited by 25
  27. 2023Privacy-preserving Adversarial Facial Featurescited by 24
  28. 2016Inverting face embeddings with convolutional neural networkscited by 22
  29. 2022OPOM: Customized Invisible Cloak towards Face Privacy Protectioncited by 22
  30. 2020Black-Box Face Recovery from Identity Featurescited by 20
  31. 2022DuetFace: Collaborative Privacy-Preserving Face Recognition via Channel Splitting in the Frequency Domaincited by 18
  32. 2019DeepObfuscator: Obfuscating Intermediate Representations with Privacy-Preserving Adversarial Learning on Smartphonescited by 15
  33. 2020FaceGuard: A Self-Supervised Defense Against Adversarial Face Imagescited by 15
  34. 2016Face Attribute Prediction Using Off-the-Shelf CNN Featurescited by 10
  35. 2017A Deep Cascade Network for Unaligned Face Attribute Classificationcited by 8

Built on by

Not cited yet.