# Impact of Facial Tattoos and Paintings on Face Recognition Systems

arXiv: https://arxiv.org/abs/2103.09939 · HTML: https://mlsanity.com/paper/2103.09939/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 61 references that are in the map.
- First posted on arXiv 17 Mar 2021.

## Builds on (most cited first, 19 of 19)

- [FaceForensics++: Learning to Detect Manipulated Facial Images](https://mlsanity.com/paper/1901.08971/) (2019)
- [Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks](https://mlsanity.com/paper/1604.02878/) (2016)
- [Deep Face Recognition: A Survey](https://mlsanity.com/paper/1804.06655/) (2018)
- [DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection](https://mlsanity.com/paper/2001.00179/) (2020)
- [DeepFakes: a New Threat to Face Recognition? Assessment and Detection](https://mlsanity.com/paper/1812.08685/) (2018)
- [Media Forensics and DeepFakes: an overview](https://mlsanity.com/paper/2001.06564/) (2020)
- [STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing](https://mlsanity.com/paper/1904.09709/) (2019)
- [SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness](https://mlsanity.com/paper/2003.09373/) (2020)
- [Demographic Bias in Biometrics: A Survey on an Emerging Challenge](https://mlsanity.com/paper/2003.02488/) (2020)
- [Face Image Quality Assessment: A Literature Survey](https://mlsanity.com/paper/2009.01103/) (2020)
- [Automatic Face Reenactment](https://mlsanity.com/paper/1602.02651/) (2016)
- [Biometric Quality: Review and Application to Face Recognition with FaceQnet](https://mlsanity.com/paper/2006.03298/) (2020)
- [A survey of face recognition techniques under occlusion](https://mlsanity.com/paper/2006.11366/) (2020)
- [Decorrelated Adversarial Learning for Age-Invariant Face Recognition](https://mlsanity.com/paper/1904.04972/) (2019)
- [Naive-Deep Face Recognition: Touching the Limit of LFW Benchmark or Not?](https://mlsanity.com/paper/1501.04690/) (2015)
- [Enhancing Convolutional Neural Networks for Face Recognition with Occlusion Maps and Batch Triplet Loss](https://mlsanity.com/paper/1707.07923/) (2017)
- [Demography-based Facial Retouching Detection using Subclass Supervised Sparse Autoencoder](https://mlsanity.com/paper/1709.07598/) (2017)
- [Recognizing Disguised Faces in the Wild](https://mlsanity.com/paper/1811.08837/) (2018)
- [Detection of Makeup Presentation Attacks based on Deep Face Representations](https://mlsanity.com/paper/2006.05074/) (2020)

## Built on by (most cited first, 2 of 2)

- [Fun Selfie Filters in Face Recognition: Impact Assessment and Removal](https://mlsanity.com/paper/2202.06022/) (2022)
- [Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognition](https://mlsanity.com/paper/2202.05297/) (2022)

## Abstract (arXiv)

In the past years, face recognition technologies have shown impressive recognition performance, mainly due to recent developments in deep convolutional neural networks. Notwithstanding those improvements, several challenges which affect the performance of face recognition systems remain. In this work, we investigate the impact that facial tattoos and paintings have on current face recognition systems. To this end, we first collected an appropriate database containing image-pairs of individuals with and without facial tattoos or paintings. The assembled database was used to evaluate how facial tattoos and paintings affect the detection, quality estimation, as well as the feature extraction and comparison modules of a face recognition system. The impact on these modules was evaluated using state-of-the-art open-source and commercial systems. The obtained results show that facial tattoos and paintings affect all the tested modules, especially for images where a large area of the face is covered with tattoos or paintings. Our work is an initial case-study and indicates a need to design algorithms which are robust to the visual changes caused by facial tattoos and paintings.