TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detection
Not on the map. Why?
Abstract (arXiv)
3D mask face presentation attack detection (PAD) plays a vital role in securing face recognition systems from emergent 3D mask attacks. Recently, remote photoplethysmography (rPPG) has been developed as an intrinsic liveness clue for 3D mask PAD without relying on the mask appearance. However, the rPPG features for 3D mask PAD are still needed expert knowledge to design manually, which limits its further progress in the deep learning and big data era. In this letter, we propose a pure rPPG transformer (TransRPPG) framework for learning intrinsic liveness representation efficiently. At first, rPPG-based multi-scale spatial-temporal maps (MSTmap) are constructed from facial skin and background regions. Then the transformer fully mines the global relationship within MSTmaps for liveness representation, and gives a binary prediction for 3D mask detection. Comprehensive experiments are conducted on two benchmark datasets to demonstrate the efficacy of the TransRPPG on both intra- and cross-dataset testings. Our TransRPPG is lightweight and efficient (with only 547K parameters and 763M FLOPs), which is promising for mobile-level applications.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 15 Apr 2021.
Builds on
20 of 41 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021TransReID: Transformer-based Object Re-Identificationcited by 432
- 2020Searching Central Difference Convolutional Networks for Face Anti-Spoofingcited by 173
- 2018Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervisioncited by 167
- 2018DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networkscited by 153
- 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 126
- 2019RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representationcited by 104
- 2020NAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofingcited by 104
- 2019Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancementcited by 86
- 2015face anti-spoofing based on color texture analysiscited by 82
8 more
- 2020Video-based Remote Physiological Measurement via Cross-verified Feature Disentanglingcited by 78
- 2020Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofingcited by 70
- 2020Face Anti-Spoofing with Human Material Perceptioncited by 62
- 2020Learning Meta Face Recognition in Unseen Domainscited by 61
- 2018Face De-Spoofing: Anti-Spoofing via Noise Modelingcited by 60
- 2020Revisiting Pixel-Wise Supervision for Face Anti-Spoofingcited by 45
- 2020AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searchingcited by 39
- 2020Cross-ethnicity Face Anti-spoofing Recognition Challenge: A Reviewcited by 25
Built on by
Citing papers per year: 2021: 11; 2022: 10; 2023: 13; 2024: 4; 2025: 2; 2026: 1.
41 papers.
Sort:
By area:
- 2021CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptationcited by 129
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
- 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurementcited by 71
- 2021KVT: k-NN Attention for Boosting Vision Transformerscited by 64
- 2021Deep Learning for Face Anti-Spoofing: A Surveycited by 64
- 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 63
- 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformercited by 46
- 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Modelscited by 39
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
- 2022Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videoscited by 26
- 2022Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cuescited by 24
- 2021Feature Generation and Hypothesis Verification for Reliable Face Anti-Spoofingcited by 23
29 more
- 2023FM-ViT: Flexible Modal Vision Transformers for Face Anti-Spoofingcited by 22
- 2022Flexible-Modal Face Anti-Spoofing: A Benchmarkcited by 20
- 2023Rethinking Vision Transformer and Masked Autoencoder in Multimodal Face Anti-Spoofingcited by 19
- 20213D High-Fidelity Mask Face Presentation Attack Detection Challengecited by 18
- 2022Digital and Physical Face Attacks: Reviewing and One Step Furthercited by 17
- 2023Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videoscited by 15
- 2022ViTransPAD: Video Transformer using convolution and self-attention for Face Presentation Attack Detectioncited by 14
- 2024PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mambacited by 14
- 2023BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurementscited by 13
- 2021Introduction to Presentation Attack Detection in Face Biometrics and Recent Advancescited by 11
- 2021AniFormer: Data-driven 3D Animation with Transformercited by 10
- 2023Visual Prompt Flexible-Modal Face Anti-Spoofingcited by 9
- 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimationcited by 6
- 2021Taming Self-Supervised Learning for Presentation Attack Detection: De-Folding and De-Mixingcited by 5
- 2022Instantaneous Physiological Estimation using Video Transformerscited by 5
- 2022Perfusion assessment via local remote photoplethysmography (rPPG)cited by 4
- 2021Review of Face Presentation Attack Detection Competitionscited by 3
- 2026FreqPhys: Repurposing Implicit Physiological Frequency Prior for Robust Remote Photoplethysmographycited by 3
- 2025Learning Knowledge-based Prompts for Robust 3D Mask Presentation Attack Detectioncited by 2
- 2025BeatFormer: Efficient motion-robust remote heart rate estimation through unsupervised spectral zoomed attention filterscited by 2
- 2023Mask Attack Detection Using Vascular-weighted Motion-robust rPPG Signalscited by 1
- 2023IFAST: Weakly Supervised Interpretable Face Anti-spoofing from Single-shot Binocular NIR Imagescited by 1
- 2023PAD-Phys: Exploiting Physiology for Presentation Attack Detection in Face Biometricscited by 1
- 2023Flow-Attention-based Spatio-Temporal Aggregation Network for 3D Mask Detectioncited by 1
- 2024G2V2former: Graph Guided Video Vision Transformer for Face Anti-Spoofingcited by 1
- 2022Multi-Frames Temporal Abnormal Clues Learning Method for Face Anti-Spoofingcited by 0
- 2022Face Presentation Attack Detectioncited by 0
- 2023A Framework for Analyzing Cross-correlators using Price's Theorem and Piecewise-Linear Decompositioncited by 0
- 2023CLIPC8: Face liveness detection algorithm based on image-text pairs and contrastive learningcited by 0
- 2026FreqPhys: Repurposing Implicit Physiological Frequency Prior for Robust Remote Photoplethysmography1 Apr 2026
- 2025BeatFormer: Efficient motion-robust remote heart rate estimation through unsupervised spectral zoomed attention filters20 Jul 2025
- 2025Learning Knowledge-based Prompts for Robust 3D Mask Presentation Attack Detection6 May 2025
- 2024PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba18 Sep 2024
- 2024G2V2former: Graph Guided Video Vision Transformer for Face Anti-Spoofing14 Aug 2024
- 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimation14 Apr 2024
- 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models6 Feb 2024
- 2023CLIPC8: Face liveness detection algorithm based on image-text pairs and contrastive learning29 Nov 2023
- 2023Flow-Attention-based Spatio-Temporal Aggregation Network for 3D Mask Detection25 Oct 2023
- 2023PAD-Phys: Exploiting Physiology for Presentation Attack Detection in Face Biometrics3 Oct 2023
- 2023IFAST: Weakly Supervised Interpretable Face Anti-spoofing from Single-shot Binocular NIR Images29 Sep 2023
- 2023Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videos15 Aug 2023
29 more
- 2023Visual Prompt Flexible-Modal Face Anti-Spoofing26 Jul 2023
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurement4 Jun 2023
- 2023Mask Attack Detection Using Vascular-weighted Motion-robust rPPG Signals25 May 2023
- 2023FM-ViT: Flexible Modal Vision Transformers for Face Anti-Spoofing5 May 2023
- 2023A Framework for Analyzing Cross-correlators using Price's Theorem and Piecewise-Linear Decomposition18 Apr 2023
- 2023BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurements21 Mar 2023
- 2023Rethinking Vision Transformer and Masked Autoencoder in Multimodal Face Anti-Spoofing11 Feb 2023
- 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformer7 Feb 2023
- 2022Face Presentation Attack Detection7 Dec 2022
- 2022Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videos30 Nov 2022
- 2022rPPG-Toolbox: Deep Remote PPG Toolbox3 Oct 2022
- 2022Digital and Physical Face Attacks: Reviewing and One Step Further29 Sep 2022
- 2022Perfusion assessment via local remote photoplethysmography (rPPG)29 Aug 2022
- 2022Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues10 Aug 2022
- 2022Multi-Frames Temporal Abnormal Clues Learning Method for Face Anti-Spoofing8 Aug 2022
- 2022ViTransPAD: Video Transformer using convolution and self-attention for Face Presentation Attack Detection3 Mar 2022
- 2022Instantaneous Physiological Estimation using Video Transformers24 Feb 2022
- 2022Flexible-Modal Face Anti-Spoofing: A Benchmark16 Feb 2022
- 2021Feature Generation and Hypothesis Verification for Reliable Face Anti-Spoofing30 Dec 2021
- 2021Review of Face Presentation Attack Detection Competitions21 Dec 2021
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer23 Nov 2021
- 2021Introduction to Presentation Attack Detection in Face Biometrics and Recent Advances23 Nov 2021
- 2021AniFormer: Data-driven 3D Animation with Transformer20 Oct 2021
- 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurement9 Oct 2021
- 2021CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation13 Sep 2021
- 2021Taming Self-Supervised Learning for Presentation Attack Detection: De-Folding and De-Mixing9 Sep 2021
- 20213D High-Fidelity Mask Face Presentation Attack Detection Challenge16 Aug 2021
- 2021Deep Learning for Face Anti-Spoofing: A Survey28 Jun 2021
- 2021KVT: k-NN Attention for Boosting Vision Transformers28 May 2021
- 2021CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptationcited by 129
- 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 118
- 2021EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurementcited by 71
- 2021KVT: k-NN Attention for Boosting Vision Transformerscited by 64
- 2021Deep Learning for Face Anti-Spoofing: A Surveycited by 64
- 2022rPPG-Toolbox: Deep Remote PPG Toolboxcited by 63
- 2023PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformercited by 46
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurementcited by 37
- 2022Learning Motion-Robust Remote Photoplethysmography through Arbitrary Resolution Videoscited by 26
- 2022Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cuescited by 24
- 2021Feature Generation and Hypothesis Verification for Reliable Face Anti-Spoofingcited by 23
- 2023FM-ViT: Flexible Modal Vision Transformers for Face Anti-Spoofingcited by 22
12 most cited of 38 All 38 (JSON)
- 2026FreqPhys: Repurposing Implicit Physiological Frequency Prior for Robust Remote Photoplethysmography1 Apr 2026
- 2025BeatFormer: Efficient motion-robust remote heart rate estimation through unsupervised spectral zoomed attention filters20 Jul 2025
- 2024G2V2former: Graph Guided Video Vision Transformer for Face Anti-Spoofing14 Aug 2024
- 2024Orientation-conditioned Facial Texture Mapping for Video-based Facial Remote Photoplethysmography Estimation14 Apr 2024
- 2023CLIPC8: Face liveness detection algorithm based on image-text pairs and contrastive learning29 Nov 2023
- 2023Flow-Attention-based Spatio-Temporal Aggregation Network for 3D Mask Detection25 Oct 2023
- 2023PAD-Phys: Exploiting Physiology for Presentation Attack Detection in Face Biometrics3 Oct 2023
- 2023IFAST: Weakly Supervised Interpretable Face Anti-spoofing from Single-shot Binocular NIR Images29 Sep 2023
- 2023Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videos15 Aug 2023
- 2023Visual Prompt Flexible-Modal Face Anti-Spoofing26 Jul 2023
- 2023rPPG-MAE: Self-supervised Pre-training with Masked Autoencoders for Remote Physiological Measurement4 Jun 2023
- 2023Mask Attack Detection Using Vascular-weighted Motion-robust rPPG Signals25 May 2023
12 newest of 38 All 38 (JSON)