# Learning Polysemantic Spoof Trace: A Multi-Modal Disentanglement Network for Face Anti-spoofing

arXiv: https://arxiv.org/abs/2212.03943 · HTML: https://mlsanity.com/paper/2212.03943/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 30 of its 58 references that are in the map.
- First posted on arXiv 7 Dec 2022.

## Builds on (most cited first, 30 of 30)

- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [CBAM: Convolutional Block Attention Module](https://mlsanity.com/paper/1807.06521/) (2018)
- [Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision](https://mlsanity.com/paper/1803.11097/) (2018)
- [Single-Side Domain Generalization for Face Anti-Spoofing](https://mlsanity.com/paper/2004.14043/) (2020)
- [Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentation](https://mlsanity.com/paper/2007.09183/) (2020)
- [Learn Convolutional Neural Network for Face Anti-Spoofing](https://mlsanity.com/paper/1408.5601/) (2014)
- [Biometric Face Presentation Attack Detection with Multi-Channel Convolutional Neural Network](https://mlsanity.com/paper/1909.08848/) (2019)
- [Deep Pixel-wise Binary Supervision for Face Presentation Attack Detection](https://mlsanity.com/paper/1907.04047/) (2019)
- [Deep Tree Learning for Zero-shot Face Anti-Spoofing](https://mlsanity.com/paper/1904.02860/) (2019)
- [Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing](https://mlsanity.com/paper/2003.08061/) (2020)
- [CASIA-SURF CeFA: A Benchmark for Multi-modal Cross-ethnicity Face Anti-spoofing](https://mlsanity.com/paper/2003.05136/) (2020)
- [Face Anti-Spoofing Via Disentangled Representation Learning](https://mlsanity.com/paper/2008.08250/) (2020)
- [Face Anti-Spoofing with Human Material Perception](https://mlsanity.com/paper/2007.02157/) (2020)
- [On Disentangling Spoof Trace for Generic Face Anti-Spoofing](https://mlsanity.com/paper/2007.09273/) (2020)
- [Face De-Spoofing: Anti-Spoofing via Noise Modeling](https://mlsanity.com/paper/1807.09968/) (2018)
- [A Dataset and Benchmark for Large-scale Multi-modal Face Anti-spoofing](https://mlsanity.com/paper/1812.00408/) (2018)
- [Generalizable Representation Learning for Mixture Domain Face Anti-Spoofing](https://mlsanity.com/paper/2105.02453/) (2021)
- [On the Effectiveness of Vision Transformers for Zero-shot Face Anti-Spoofing](https://mlsanity.com/paper/2011.08019/) (2020)
- [Cross Modal Focal Loss for RGBD Face Anti-Spoofing](https://mlsanity.com/paper/2103.00948/) (2021)
- [Multi-Modal Face Anti-Spoofing Based on Central Difference Networks](https://mlsanity.com/paper/2004.08388/) (2020)
- [Learning One Class Representations for Face Presentation Attack Detection using Multi-channel Convolutional Neural Networks](https://mlsanity.com/paper/2007.11457/) (2020)
- [Meta-Teacher For Face Anti-Spoofing](https://mlsanity.com/paper/2111.06638/) (2021)
- [Deep Models and Shortwave Infrared Information to Detect Face Presentation Attacks](https://mlsanity.com/paper/2007.11469/) (2020)
- [Dual Spoof Disentanglement Generation for Face Anti-spoofing with Depth Uncertainty Learning](https://mlsanity.com/paper/2112.00568/) (2021)
- [FeatherNets: Convolutional Neural Networks as Light as Feather for Face Anti-spoofing](https://mlsanity.com/paper/1904.09290/) (2019)
- [Learning Generalized Spoof Cues for Face Anti-spoofing](https://mlsanity.com/paper/2005.03922/) (2020)
- [Domain Adaptation in Multi-Channel Autoencoder based Features for Robust Face Anti-Spoofing](https://mlsanity.com/paper/1907.04048/) (2019)
- [Disentangled Representation with Dual-stage Feature Learning for Face Anti-spoofing](https://mlsanity.com/paper/2110.09157/) (2021)
- [Physics-Guided Spoof Trace Disentanglement for Generic Face Anti-Spoofing](https://mlsanity.com/paper/2012.05185/) (2020)
- [On the Learning of Deep Local Features for Robust Face Spoofing Detection](https://mlsanity.com/paper/1806.07492/) (2018)

## Built on by (most cited first, 3 of 3)

- [Fine-Grained Annotation for Face Anti-Spoofing](https://mlsanity.com/paper/2310.08142/) (2023)
- [Self-supervised Feature Disentanglement and Augmentation Network for One-class Face Anti-spoofing](https://mlsanity.com/paper/2503.22929/) (2025)
- [Multi-Modal Face Anti-Spoofing via Cross-Modal Feature Transitions](https://mlsanity.com/paper/2507.05575/) (2025)

## Abstract (arXiv)

Along with the widespread use of face recognition systems, their vulnerability has become highlighted. While existing face anti-spoofing methods can be generalized between attack types, generic solutions are still challenging due to the diversity of spoof characteristics. Recently, the spoof trace disentanglement framework has shown great potential for coping with both seen and unseen spoof scenarios, but the performance is largely restricted by the single-modal input. This paper focuses on this issue and presents a multi-modal disentanglement model which targetedly learns polysemantic spoof traces for more accurate and robust generic attack detection. In particular, based on the adversarial learning mechanism, a two-stream disentangling network is designed to estimate spoof patterns from the RGB and depth inputs, respectively. In this case, it captures complementary spoofing clues inhering in different attacks. Furthermore, a fusion module is exploited, which recalibrates both representations at multiple stages to promote the disentanglement in each individual modality. It then performs cross-modality aggregation to deliver a more comprehensive spoof trace representation for prediction. Extensive evaluations are conducted on multiple benchmarks, demonstrating that learning polysemantic spoof traces favorably contributes to anti-spoofing with more perceptible and interpretable results.