# The Effect of Wearing a Face Mask on Face Image Quality

arXiv: https://arxiv.org/abs/2110.11283 · HTML: https://mlsanity.com/paper/2110.11283/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 35 references that are in the map.
- First posted on arXiv 21 Oct 2021.

## Builds on (most cited first, 20 of 20)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- ["Why Should I Trust You?": Explaining the Predictions of Any Classifier](https://mlsanity.com/paper/1602.04938/) (2016)
- [Learning Deep Features for Discriminative Localization](https://mlsanity.com/paper/1512.04150/) (2015)
- [Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks](https://mlsanity.com/paper/1604.02878/) (2016)
- [SphereFace: Deep Hypersphere Embedding for Face Recognition](https://mlsanity.com/paper/1704.08063/) (2017)
- [MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition](https://mlsanity.com/paper/1607.08221/) (2016)
- [Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks](https://mlsanity.com/paper/1910.01279/) (2019)
- [MagFace: A Universal Representation for Face Recognition and Quality Assessment](https://mlsanity.com/paper/2103.06627/) (2021)
- [ElasticFace: Elastic Margin Loss for Deep Face Recognition](https://mlsanity.com/paper/2109.09416/) (2021)
- [SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness](https://mlsanity.com/paper/2003.09373/) (2020)
- [Face Image Quality Assessment: A Literature Survey](https://mlsanity.com/paper/2009.01103/) (2020)
- [FaceQnet: Quality Assessment for Face Recognition based on Deep Learning](https://mlsanity.com/paper/1904.01740/) (2019)
- [Biometric Quality: Review and Application to Face Recognition with FaceQnet](https://mlsanity.com/paper/2006.03298/) (2020)
- [PocketNet: Extreme Lightweight Face Recognition Network using Neural Architecture Search and Multi-Step Knowledge Distillation](https://mlsanity.com/paper/2108.10710/) (2021)
- [Self-restrained Triplet Loss for Accurate Masked Face Recognition](https://mlsanity.com/paper/2103.01716/) (2021)
- [The Effect of Wearing a Mask on Face Recognition Performance: an Exploratory Study](https://mlsanity.com/paper/2007.13521/) (2020)
- [MFR 2021: Masked Face Recognition Competition](https://mlsanity.com/paper/2106.15288/) (2021)
- [Biometrics in the Era of COVID-19: Challenges and Opportunities](https://mlsanity.com/paper/2102.09258/) (2021)
- [My Eyes Are Up Here: Promoting Focus on Uncovered Regions in Masked Face Recognition](https://mlsanity.com/paper/2108.00996/) (2021)

## Built on by (most cited first, 7 of 7)

- [FocusFace: Multi-task Contrastive Learning for Masked Face Recognition](https://mlsanity.com/paper/2110.14940/) (2021)
- [Partial Attack Supervision and Regional Weighted Inference for Masked Face Presentation Attack Detection](https://mlsanity.com/paper/2111.04336/) (2021)
- [Mask-invariant Face Recognition through Template-level Knowledge Distillation](https://mlsanity.com/paper/2112.05646/) (2021)
- [Face Morphing Attacks and Face Image Quality: The Effect of Morphing and the Unsupervised Attack Detection by Quality](https://mlsanity.com/paper/2208.05864/) (2022)
- [Explainability of the Implications of Supervised and Unsupervised Face Image Quality Estimations Through Activation Map Variation Analyses in Face Recognition Models](https://mlsanity.com/paper/2112.04827/) (2021)
- [OCFR 2022: Competition on Occluded Face Recognition From Synthetically Generated Structure-Aware Occlusions](https://mlsanity.com/paper/2208.02760/) (2022)
- [A Survey on Computer Vision based Human Analysis in the COVID-19 Era](https://mlsanity.com/paper/2211.03705/) (2022)

## Abstract (arXiv)

Due to the COVID-19 situation, face masks have become a main part of our daily life. Wearing mouth-and-nose protection has been made a mandate in many public places, to prevent the spread of the COVID-19 virus. However, face masks affect the performance of face recognition, since a large area of the face is covered. The effect of wearing a face mask on the different components of the face recognition system in a collaborative environment is a problem that is still to be fully studied. This work studies, for the first time, the effect of wearing a face mask on face image quality by utilising state-of-the-art face image quality assessment methods of different natures. This aims at providing better understanding on the effect of face masks on the operation of face recognition as a whole system. In addition, we further studied the effect of simulated masks on face image utility in comparison to real face masks. We discuss the correlation between the mask effect on face image quality and that on the face verification performance by automatic systems and human experts, indicating a consistent trend between both factors. The evaluation is conducted on the database containing (1) no-masked faces, (2) real face masks, and (3) simulated face masks, by synthetically generating digital facial masks on no-masked faces. Finally, a visual interpretation of the face areas contributing to the quality score of a selected set of quality assessment methods is provided to give a deeper insight into the difference of network decisions in masked and non-masked faces, among other variations.