mlsanityData to 7 Oct 2026

Foundation and Multimodal Large Language Models for Face Presentation and Morph Attack Detection

arXiv 2608.29802 ↗First posted 30 Aug 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness

Abstract (arXiv)

Face recognition systems are increasingly deployed in security-critical applications, yet they remain vulnerable to presentation and morph attacks. Presentation attack detection (PAD) and morphing attack detection (MAD) are therefore essential components of trustworthy face biometrics. Despite advancements in PAD and MAD methods, existing detectors suffer from limited generalization and degrade in cross-dataset evaluation. In this paper, we systematically investigate whether general-purpose foundation models (FMs) and multimodal large language models (MLLMs) encode PAD-relevant and MAD-relevant information, and how such models can best be deployed for both tasks. We study five approaches with increasing access to the internal information of the model: (i) zero-shot prompting of off-the-shelf MLLMs; (ii) training a shallow model on the next-token logit probabilities at the output of the MLLM; (iii) parameter-efficient fine-tuning on task-specific question-answer data, yielding two specialized MLLMs, called PADLLM and MADLLM, which additionally provide textual reasoning for their decisions; (iv) linear probing of frozen vision encoders; and (v) fine-tuning of vision encoders of FMs and MLLMs. We benchmark 16 open-weight MLLMs and 30 vision encoder backbones on four PAD datasets (MSU-MFSD, CASIA-FASD, Replay-Attack, and OULU-NPU) and four MAD datasets (FFHQ, FRGC, FRLL, and FERET). Our experiments show that FMs and MLLMs can achieve significant performance for PAD and MAD. In addition, the fine-tuned models achieve state-of-the-art detection performance in cross-dataset evaluation, indicating that general-purpose pretrained representations carry substantial attack-relevant information. Source code of all our experiments will be publicly released.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 76 of its 108 references that are in the map. First posted on arXiv 30 Aug 2026.

Builds on

76 of 108 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Emergent Morphing Attack Detection in Open Multi-modal Large Language Models17 Feb
  2. 2025InstructFLIP: Exploring Unified Vision-Language Model for Face Anti-spoofing16 Jul
  3. 2025Benchmarking Foundation Models for Zero-Shot Biometric Tasks30 May
  4. 2025Interpretable Face Anti-Spoofing: Enhancing Generalization with Multimodal Large Language Models3 Jan
  5. 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics21 Mar
  6. 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models6 Feb

Other references · 70

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  7. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2024Qwen2.5 Technical Reportcited by 4,713
  10. 2024GPT-4o System Cardcited by 4,467
  11. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  12. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
38 more
  1. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  2. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  4. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  8. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  9. 2025DINOv3cited by 1,297
  10. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  11. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  12. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
  13. 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
  14. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
  15. 2023A Comprehensive Overview of Large Language Modelscited by 639
  16. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  17. 2024What matters when building vision-language models?cited by 321
  18. 2023OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documentscited by 316
  19. 2022Masked Siamese Networks for Label-Efficient Learningcited by 301
  20. 2024Building and better understanding vision-language models: insights and future directionscited by 169
  21. 2018Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervisioncited by 167
  22. 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Modelcited by 167
  23. 2020Single-Side Domain Generalization for Face Anti-Spoofingcited by 139
  24. 2019Regularized Fine-grained Meta Face Anti-spoofingcited by 86
  25. 2019Deep Pixel-wise Binary Supervision for Face Presentation Attack Detectioncited by 76
  26. 2022PatchNet: A Simple Face Anti-Spoofing Framework via Fine-Grained Patch Recognitioncited by 67
  27. 2020Face Morphing Attack Generation & Detection: A Comprehensive Surveycited by 63
  28. 2020Can GAN Generated Morphs Threaten Face Recognition Systems Equally as Landmark Based Morphs? -- Vulnerability and Detectioncited by 46
  29. 2023FLIP: Cross-domain Face Anti-spoofing with Language Guidancecited by 45
  30. 2023MorDIFF: Recognition Vulnerability and Attack Detectability of Face Morphing Attacks Created by Diffusion Autoencoderscited by 44
  31. 2024CFPL-FAS: Class Free Prompt Learning for Generalizable Face Anti-spoofingcited by 39
  32. 2020Vulnerability Analysis of Face Morphing Attacks from Landmarks and Generative Adversarial Networkscited by 36
  33. 2020Deep Models and Shortwave Infrared Information to Detect Face Presentation Attackscited by 29
  34. 2022Are GAN-based Morphs Threatening Face Recognition?cited by 28
  35. 2024FRoundation: Are Foundation Models Ready for Face Recognition?cited by 22
  36. 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learningcited by 21
  37. 2021Real Masks and Spoof Faces: On the Masked Face Presentation Attack Detectioncited by 20
  38. 2024ChatGPT and biometrics: an assessment of face recognition, gender detection, and age estimation capabilitiescited by 20

50 most cited of 70 All 70 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Zero-Shot Differential Morphing Attack Detection with Multimodal Large Language Models
  2. 2025ChatGPT Encounters Morphing Attack Detection: Zero-Shot MAD with Multi-Modal Large Language Models and General Vision Models
  3. 2025FaceShield: Explainable Face Anti-Spoofing with Multimodal Large Language Models
  4. 2026MS-MFAD : Multimodal large language models for Face Anti-spoofing Detection
  5. 2025In-context Learning of Vision Language Models for Detection of Physical and Digital Attacks against Face Recognition Systems
  6. 2026Generalist Multimodal LLMs Gain Biometric Expertise via Human Salience
  7. 2023Face Morphing Attack Detection with Denoising Diffusion Probabilistic Models
  8. 2026CPG-PAD: Concept-Informed Prompts Guided Presentation Attack Detection