Crafter: Facial Feature Crafting against Inversion-based Identity Theft on Deep Models
Not on the map. Why?
Abstract (arXiv)
With the increased capabilities at the edge (e.g., mobile device) and more stringent privacy requirement, it becomes a recent trend for deep learning-enabled applications to pre-process sensitive raw data at the edge and transmit the features to the backend cloud for further processing. A typical application is to run machine learning (ML) services on facial images collected from different individuals. To prevent identity theft, conventional methods commonly rely on an adversarial game-based approach to shed the identity information from the feature. However, such methods can not defend against adaptive attacks, in which an attacker takes a countermove against a known defence strategy. We propose Crafter, a feature crafting mechanism deployed at the edge, to protect the identity information from adaptive model inversion attacks while ensuring the ML tasks are properly carried out in the cloud. The key defence strategy is to mislead the attacker to a non-private prior from which the attacker gains little about the private identity. In this case, the crafted features act like poison training samples for attackers with adaptive model updates. Experimental results indicate that Crafter successfully defends both basic and possible adaptive attacks, which can not be achieved by state-of-the-art adversarial game-based methods.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 39 references that are in the map. First posted on arXiv 14 Jan 2024.
Builds on
26 of 39 references.
References · 26
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2016Deep Learning with Differential Privacycited by 2,682
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2017The Perception-Distortion Tradeoffcited by 582
- 2020On Adaptive Attacks to Adversarial Example Defensescited by 547
- 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 528
- 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 500
- 2014Understanding Deep Image Representations by Inverting Themcited by 399
- 2019Optimizing Millions of Hyperparameters by Implicit Differentiationcited by 303
- 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 285
- 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 241
14 more
- 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 207
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2021LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognitioncited by 92
- 2020InstaHide: Instance-hiding Schemes for Private Distributed Learningcited by 90
- 2020Improving Robustness to Model Inversion Attacks via Mutual Information Regularizationcited by 49
- 2021Data Poisoning Won't Save You From Facial Recognitioncited by 45
- 2016Studying Very Low Resolution Recognition Using Deep Networkscited by 36
- 2019Adversarial Learning of Privacy-Preserving and Task-Oriented Representationscited by 35
- 2021DataLens: Scalable Privacy Preserving Training via Gradient Compression and Aggregationcited by 31
- 2020DISCO: Dynamic and Invariant Sensitive Channel Obfuscation for deep neural networkscited by 23
- 2021Perceptual Indistinguishability-Net (PI-Net): Facial Image Obfuscation with Manipulable Semanticscited by 20
- 2020TIPRDC: Task-Independent Privacy-Respecting Data Crowdsourcing Framework for Deep Learning with Anonymized Intermediate Representationscited by 17
- 2019DeepObfuscator: Obfuscating Intermediate Representations with Privacy-Preserving Adversarial Learning on Smartphonescited by 15
- 2022UnGANable: Defending Against GAN-based Face Manipulationcited by 15
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.