# Partial Attack Supervision and Regional Weighted Inference for Masked Face Presentation Attack Detection

arXiv: https://arxiv.org/abs/2111.04336 · HTML: https://mlsanity.com/paper/2111.04336/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 39 references that are in the map.
- First posted on arXiv 8 Nov 2021.

## Builds on (most cited first, 22 of 22)

- [Densely Connected Convolutional Networks](https://mlsanity.com/paper/1608.06993/) (2016)
- [Rethinking the Inception Architecture for Computer Vision](https://mlsanity.com/paper/1512.00567/) (2015)
- [Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks](https://mlsanity.com/paper/1604.02878/) (2016)
- [Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision](https://mlsanity.com/paper/1803.11097/) (2018)
- [ElasticFace: Elastic Margin Loss for Deep Face Recognition](https://mlsanity.com/paper/2109.09416/) (2021)
- [Deep Pixel-wise Binary Supervision for Face Presentation Attack Detection](https://mlsanity.com/paper/1907.04047/) (2019)
- [Face De-Spoofing: Anti-Spoofing via Noise Modeling](https://mlsanity.com/paper/1807.09968/) (2018)
- [Masked Face Recognition for Secure Authentication](https://mlsanity.com/paper/2008.11104/) (2020)
- [Revisiting Pixel-Wise Supervision for Face Anti-Spoofing](https://mlsanity.com/paper/2011.12032/) (2020)
- [MixFaceNets: Extremely Efficient Face Recognition Networks](https://mlsanity.com/paper/2107.13046/) (2021)
- [Self-restrained Triplet Loss for Accurate Masked Face Recognition](https://mlsanity.com/paper/2103.01716/) (2021)
- [The Effect of Wearing a Mask on Face Recognition Performance: an Exploratory Study](https://mlsanity.com/paper/2007.13521/) (2020)
- [MFR 2021: Masked Face Recognition Competition](https://mlsanity.com/paper/2106.15288/) (2021)
- [Real Masks and Spoof Faces: On the Masked Face Presentation Attack Detection](https://mlsanity.com/paper/2103.01546/) (2021)
- [Look Locally Infer Globally: A Generalizable Face Anti-Spoofing Approach](https://mlsanity.com/paper/2006.02834/) (2020)
- [Learnable Multi-level Frequency Decomposition and Hierarchical Attention Mechanism for Generalized Face Presentation Attack Detection](https://mlsanity.com/paper/2109.07950/) (2021)
- [Iris Presentation Attack Detection by Attention-based and Deep Pixel-wise Binary Supervision Network](https://mlsanity.com/paper/2106.14845/) (2021)
- [On Recognizing Occluded Faces in the Wild](https://mlsanity.com/paper/2109.03672/) (2021)
- [Masked Face Recognition: Human vs. Machine](https://mlsanity.com/paper/2103.01924/) (2021)
- [My Eyes Are Up Here: Promoting Focus on Uncovered Regions in Masked Face Recognition](https://mlsanity.com/paper/2108.00996/) (2021)
- [The Effect of Wearing a Face Mask on Face Image Quality](https://mlsanity.com/paper/2110.11283/) (2021)
- [Shuffled Patch-Wise Supervision for Presentation Attack Detection](https://mlsanity.com/paper/2109.03484/) (2021)

## Built on by (most cited first, 10 of 10)

- [Privacy-friendly Synthetic Data for the Development of Face Morphing Attack Detectors](https://mlsanity.com/paper/2203.06691/) (2022)
- [SYN-MAD 2022: Competition on Face Morphing Attack Detection Based on Privacy-aware Synthetic Training Data](https://mlsanity.com/paper/2208.07337/) (2022)
- [SynthASpoof: Developing Face Presentation Attack Detection Based on Privacy-friendly Synthetic Data](https://mlsanity.com/paper/2303.02660/) (2023)
- [Fairness in Face Presentation Attack Detection](https://mlsanity.com/paper/2209.09035/) (2022)
- [Consistency Regularization for Deep Face Anti-Spoofing](https://mlsanity.com/paper/2111.12320/) (2021)
- [OCFR 2022: Competition on Occluded Face Recognition From Synthetically Generated Structure-Aware Occlusions](https://mlsanity.com/paper/2208.02760/) (2022)
- [Face Presentation Attack Detection by Excavating Causal Clues and Adapting Embedding Statistics](https://mlsanity.com/paper/2308.14551/) (2023)
- [Generalized Face Anti-Spoofing via Multi-Task Learning and One-Side Meta Triplet Loss](https://mlsanity.com/paper/2211.15955/) (2022)
- [Liveness score-based regression neural networks for face anti-spoofing](https://mlsanity.com/paper/2302.09461/) (2023)
- [A Survey on Computer Vision based Human Analysis in the COVID-19 Era](https://mlsanity.com/paper/2211.03705/) (2022)

## Abstract (arXiv)

Wearing a mask has proven to be one of the most effective ways to prevent the transmission of SARS-CoV-2 coronavirus. However, wearing a mask poses challenges for different face recognition tasks and raises concerns about the performance of masked face presentation detection (PAD). The main issues facing the mask face PAD are the wrongly classified bona fide masked faces and the wrongly classified partial attacks (covered by real masks). This work addresses these issues by proposing a method that considers partial attack labels to supervise the PAD model training, as well as regional weighted inference to further improve the PAD performance by varying the focus on different facial areas. Our proposed method is not directly linked to specific network architecture and thus can be directly incorporated into any common or custom-designed network. In our work, two neural networks (DeepPixBis and MixFaceNet) are selected as backbones. The experiments are demonstrated on the collaborative real mask attack (CRMA) database. Our proposed method outperforms established PAD methods in the CRMA database by reducing the mentioned shortcomings when facing masked faces. Moreover, we present a detailed step-wise ablation study pointing out the individual and joint benefits of the proposed concepts on the overall PAD performance.
