Foundation and Multimodal Large Language Models for Face Presentation and Morph Attack Detection
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Face recognition systems are increasingly deployed in security-critical applications, yet they remain vulnerable to presentation and morph attacks. Presentation attack detection (PAD) and morphing attack detection (MAD) are therefore essential components of trustworthy face biometrics. Despite advancements in PAD and MAD methods, existing detectors suffer from limited generalization and degrade in cross-dataset evaluation. In this paper, we systematically investigate whether general-purpose foundation models (FMs) and multimodal large language models (MLLMs) encode PAD-relevant and MAD-relevant information, and how such models can best be deployed for both tasks. We study five approaches with increasing access to the internal information of the model: (i) zero-shot prompting of off-the-shelf MLLMs; (ii) training a shallow model on the next-token logit probabilities at the output of the MLLM; (iii) parameter-efficient fine-tuning on task-specific question-answer data, yielding two specialized MLLMs, called PADLLM and MADLLM, which additionally provide textual reasoning for their decisions; (iv) linear probing of frozen vision encoders; and (v) fine-tuning of vision encoders of FMs and MLLMs. We benchmark 16 open-weight MLLMs and 30 vision encoder backbones on four PAD datasets (MSU-MFSD, CASIA-FASD, Replay-Attack, and OULU-NPU) and four MAD datasets (FFHQ, FRGC, FRLL, and FERET). Our experiments show that FMs and MLLMs can achieve significant performance for PAD and MAD. In addition, the fine-tuned models achieve state-of-the-art detection performance in cross-dataset evaluation, indicating that general-purpose pretrained representations carry substantial attack-relevant information. Source code of all our experiments will be publicly released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 76 of its 108 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
76 of 108 references.
Closest ancestors · 6
Same direction, newest first
- 2026Emergent Morphing Attack Detection in Open Multi-modal Large Language Models17 Feb
- 2025InstructFLIP: Exploring Unified Vision-Language Model for Face Anti-spoofing16 Jul
- 2025Benchmarking Foundation Models for Zero-Shot Biometric Tasks30 May
- 2025Interpretable Face Anti-Spoofing: Enhancing Generalization with Multimodal Large Language Models3 Jan
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics21 Mar
- 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models6 Feb
Other references · 70
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024GPT-4o System Cardcited by 4,467
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
38 more
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2025DINOv3cited by 1,297
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2024What matters when building vision-language models?cited by 321
- 2023OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documentscited by 316
- 2022Masked Siamese Networks for Label-Efficient Learningcited by 301
- 2024Building and better understanding vision-language models: insights and future directionscited by 169
- 2018Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervisioncited by 167
- 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Modelcited by 167
- 2020Single-Side Domain Generalization for Face Anti-Spoofingcited by 139
- 2019Regularized Fine-grained Meta Face Anti-spoofingcited by 86
- 2019Deep Pixel-wise Binary Supervision for Face Presentation Attack Detectioncited by 76
- 2022PatchNet: A Simple Face Anti-Spoofing Framework via Fine-Grained Patch Recognitioncited by 67
- 2020Face Morphing Attack Generation & Detection: A Comprehensive Surveycited by 63
- 2020Can GAN Generated Morphs Threaten Face Recognition Systems Equally as Landmark Based Morphs? -- Vulnerability and Detectioncited by 46
- 2023FLIP: Cross-domain Face Anti-spoofing with Language Guidancecited by 45
- 2023MorDIFF: Recognition Vulnerability and Attack Detectability of Face Morphing Attacks Created by Diffusion Autoencoderscited by 44
- 2024CFPL-FAS: Class Free Prompt Learning for Generalizable Face Anti-spoofingcited by 39
- 2020Vulnerability Analysis of Face Morphing Attacks from Landmarks and Generative Adversarial Networkscited by 36
- 2020Deep Models and Shortwave Infrared Information to Detect Face Presentation Attackscited by 29
- 2022Are GAN-based Morphs Threatening Face Recognition?cited by 28
- 2024FRoundation: Are Foundation Models Ready for Face Recognition?cited by 22
- 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learningcited by 21
- 2021Real Masks and Spoof Faces: On the Masked Face Presentation Attack Detectioncited by 20
- 2024ChatGPT and biometrics: an assessment of face recognition, gender detection, and age estimation capabilitiescited by 20
50 most cited of 70 All 70 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Zero-Shot Differential Morphing Attack Detection with Multimodal Large Language Models
- 2025ChatGPT Encounters Morphing Attack Detection: Zero-Shot MAD with Multi-Modal Large Language Models and General Vision Models
- 2025FaceShield: Explainable Face Anti-Spoofing with Multimodal Large Language Models
- 2026MS-MFAD : Multimodal large language models for Face Anti-spoofing Detection
- 2025In-context Learning of Vision Language Models for Detection of Physical and Digital Attacks against Face Recognition Systems
- 2026Generalist Multimodal LLMs Gain Biometric Expertise via Human Salience
- 2023Face Morphing Attack Detection with Denoising Diffusion Probabilistic Models
- 2026CPG-PAD: Concept-Informed Prompts Guided Presentation Attack Detection