# Robust Skin Color Driven Privacy Preserving Face Recognition via Function Secret Sharing

arXiv: https://arxiv.org/abs/2407.05045 · HTML: https://mlsanity.com/paper/2407.05045/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 14 of its 30 references that are in the map.
- First posted on arXiv 6 Jul 2024.

## Builds on (most cited first, 14 of 14)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [VGGFace2: A dataset for recognising faces across pose and age](https://mlsanity.com/paper/1710.08092/) (2017)
- [MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition](https://mlsanity.com/paper/1607.08221/) (2016)
- [Towards Real-World Blind Face Restoration with Generative Facial Prior](https://mlsanity.com/paper/2101.04061/) (2021)
- [Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environments](https://mlsanity.com/paper/1708.08197/) (2017)
- [MobileFaceNets: Efficient CNNs for Accurate Real-Time Face Verification on Mobile Devices](https://mlsanity.com/paper/1804.07573/) (2018)
- [Quantization Guided JPEG Artifact Correction](https://mlsanity.com/paper/2004.09320/) (2020)
- [Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain](https://mlsanity.com/paper/2207.07316/) (2022)
- [Towards Protecting Face Embeddings in Mobile Face Verification Scenarios](https://mlsanity.com/paper/2110.00434/) (2021)
- [FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders](https://mlsanity.com/paper/2205.11090/) (2022)
- [Color-related Local Binary Pattern: A Learned Local Descriptor for Color Image Recognition](https://mlsanity.com/paper/2012.06132/) (2020)
- [Privacy-Preserving Face Recognition in Hybrid Frequency-Color Domain](https://mlsanity.com/paper/2401.13386/) (2024)
- [FaceSkin: A Privacy Preserving Facial skin patch Dataset for multi Attributes classification](https://mlsanity.com/paper/2308.04765/) (2023)

## Abstract (arXiv)

In this work, we leverage the pure skin color patch from the face image as the additional information to train an auxiliary skin color feature extractor and face recognition model in parallel to improve performance of state-of-the-art (SOTA) privacy-preserving face recognition (PPFR) systems. Our solution is robust against black-box attacking and well-established generative adversarial network (GAN) based image restoration. We analyze the potential risk in previous work, where the proposed cosine similarity computation might directly leak the protected precomputed embedding stored on the server side. We propose a Function Secret Sharing (FSS) based face embedding comparison protocol without any intermediate result leakage. In addition, we show in experiments that the proposed protocol is more efficient compared to the Secret Sharing (SS) based protocol.