LoRA-based Adaptation Alone Is Not Enough: Understanding the Limits of Foundation Models for Face Presentation Attack Detection
Not on the map. Why?
Abstract (arXiv)
Face presentation attack detection (PAD) aims to reliably detect a wide range of presentation attacks. While PAD methods achieve strong performance within individual datasets, their performance degrades under cross-dataset evaluation. Variations in sensors or lighting conditions can reduce the effectiveness of detectors from near-perfect to nearly random. Foundation models (FMs) have emerged as a promising alternative because typical PAD datasets, such as the MCIO benchmarks (MSU-MFSD, CASIA-FASD, Replay-Attack, and OULU-NPU), are small relative to the scale used for web-based pretraining. However, existing PAD systems primarily focus on CLIP-based foundation models, while overlooking other FMs with different architectures and training procedures. This study addresses this question by systematically evaluating 32 FMs. Zero-shot prompting achieves performance near chance across model families and scales. The vision encoders, when low-rankadapted (LoRA) with fewer than 1% trainable weights, achieve below 2% intra-dataset ACER in most cases, while cross-dataset ACER is substantially higher. LoRA primarily refines the decision boundary within a dataset, suggesting that pretrained representations and the adaptation dataset play a larger role in cross-dataset generalization than the evaluated lightweight adaptation strategy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 81 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
56 of 81 references.
References · 56
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
38 more
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2025DINOv3cited by 1,414
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 914
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2023OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documentscited by 316
- 2022Masked Siamese Networks for Label-Efficient Learningcited by 302
- 2021WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learningcited by 287
- 2023Data Filtering Networkscited by 250
- 2018WikiHow: A Large Scale Text Summarization Datasetcited by 204
- 2020Searching Central Difference Convolutional Networks for Face Anti-Spoofingcited by 173
- 2018Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervisioncited by 167
- 2021ElasticFace: Elastic Margin Loss for Deep Face Recognitioncited by 144
- 2020Single-Side Domain Generalization for Face Anti-Spoofingcited by 139
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
- 2020CelebA-Spoof: Large-Scale Face Anti-Spoofing Dataset with Rich Annotationscited by 109
- 2020NAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofingcited by 105
- 2024EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameterscited by 99
- 2019Regularized Fine-grained Meta Face Anti-spoofingcited by 86
- 2019Deep Pixel-wise Binary Supervision for Face Presentation Attack Detectioncited by 76
- 2022PatchNet: A Simple Face Anti-Spoofing Framework via Fine-Grained Patch Recognitioncited by 67
- 2020Revisiting Pixel-Wise Supervision for Face Anti-Spoofingcited by 45
- 2023FLIP: Cross-domain Face Anti-spoofing with Language Guidancecited by 45
- 2024CFPL-FAS: Class Free Prompt Learning for Generalizable Face Anti-spoofingcited by 39
- 2022Adaptive Transformers for Robust Few-shot Cross-domain Face Anti-spoofingcited by 38
- 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learningcited by 23
- 2021Real Masks and Spoof Faces: On the Masked Face Presentation Attack Detectioncited by 20
- 2021Learnable Multi-level Frequency Decomposition and Hierarchical Attention Mechanism for Generalized Face Presentation Attack Detectioncited by 18
- 2023SynthASpoof: Developing Face Presentation Attack Detection Based on Privacy-friendly Synthetic Datacited by 17
- 2024Towards Data-Centric Face Anti-Spoofing: Improving Cross-domain Generalization via Physics-based Data Synthesiscited by 16
- 2025FoundPAD: Foundation Models Reloaded for Face Presentation Attack Detectioncited by 14
- 2025Exploring ChatGPT for Face Presentation Attack Detection in Zero and Few-Shot in-Context Learningcited by 12
- 2025Interpretable Face Anti-Spoofing: Enhancing Generalization with Multimodal Large Language Modelscited by 11
- 2023Face Presentation Attack Detection by Excavating Causal Clues and Adapting Embedding Statisticscited by 7
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.