Interpretable Face Anti-Spoofing: Enhancing Generalization with Multimodal Large Language Models
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Face Anti-Spoofing (FAS) is essential for ensuring the security and reliability of facial recognition systems. Most existing FAS methods are formulated as binary classification tasks, providing confidence scores without interpretation. They exhibit limited generalization in out-of-domain scenarios, such as new environments or unseen spoofing types. In this work, we introduce a multimodal large language model (MLLM) framework for FAS, termed Interpretable Face Anti-Spoofing (I-FAS), which transforms the FAS task into an interpretable visual question answering (VQA) paradigm. Specifically, we propose a Spoof-aware Captioning and Filtering (SCF) strategy to generate high-quality captions for FAS images, enriching the model's supervision with natural language interpretations. To mitigate the impact of noisy captions during training, we develop a Lopsided Language Model (L-LM) loss function that separates loss calculations for judgment and interpretation, prioritizing the optimization of the former. Furthermore, to enhance the model's perception of global visual features, we design a Globally Aware Connector (GAC) to align multi-level visual representations with the language model. Extensive experiments on standard and newly devised One to Eleven cross-domain benchmarks, comprising 12 public datasets, demonstrate that our method significantly outperforms state-of-the-art methods.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 4 of its 60 references that are in the map. First posted on arXiv 3 Jan 2025.
Builds on
4 of 60 references.
Closest ancestors · 1
Same direction, newest first
Other references · 3
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2023From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Modelscited by 96
- 2024An empirical study of LLaMA3 quantization: from LLMs to MLLMscited by 63
Built on by
Citing papers per year: 2025: 3; 2026: 8.
11 papers.
- 2025FaceShield: Explainable Face Anti-Spoofing with Multimodal Large Language Modelscited by 6
- 2025Harnessing Chain-of-Thought Reasoning in Multimodal Large Language Models for Face Anti-Spoofingcited by 5
- 2026Benchmarking Vision Foundation Models for Domain-Generalizable Face Anti-Spoofingcited by 4
- 2026From Intuition to Investigation: A Tool-Augmented Reasoning MLLM Framework for Generalizable Face Anti-Spoofingcited by 2
- 2025Learning Unknown Spoof Prompts for Generalized Face Anti-Spoofing Using Only Real Face Imagescited by 1
- 2026CPG-PAD: Concept-Informed Prompts Guided Presentation Attack Detectioncited by 1
- 2026Foundation Models for Face Presentation Attack Detection: A Unified Linear-Probing Benchmarkcited by 1
- 2026DINO-VPT: Hierarchical Visual Prompt Tuning for Joint Physical-Digital Face Anti-Spoofingcited by 0
- 2026LoRA-based Adaptation Alone Is Not Enough: Understanding the Limits of Foundation Models for Face Presentation Attack Detectioncited by 0
- 2026Primitive-Driven Compositional Forensic Visual Prompting for Open-World Face Anti-Spoofingcited by 0
- 2026Foundation and Multimodal Large Language Models for Face Presentation and Morph Attack Detectioncited by 0
- 2026Foundation and Multimodal Large Language Models for Face Presentation and Morph Attack Detection30 Aug 2026
- 2026Primitive-Driven Compositional Forensic Visual Prompting for Open-World Face Anti-Spoofing18 Aug 2026
- 2026LoRA-based Adaptation Alone Is Not Enough: Understanding the Limits of Foundation Models for Face Presentation Attack Detection10 Aug 2026
- 2026Foundation Models for Face Presentation Attack Detection: A Unified Linear-Probing Benchmark29 Jul 2026
- 2026DINO-VPT: Hierarchical Visual Prompt Tuning for Joint Physical-Digital Face Anti-Spoofing23 Jul 2026
- 2026CPG-PAD: Concept-Informed Prompts Guided Presentation Attack Detection1 Jul 2026
- 2026Benchmarking Vision Foundation Models for Domain-Generalizable Face Anti-Spoofing21 Apr 2026
- 2026From Intuition to Investigation: A Tool-Augmented Reasoning MLLM Framework for Generalizable Face Anti-Spoofing1 Mar 2026
- 2025Harnessing Chain-of-Thought Reasoning in Multimodal Large Language Models for Face Anti-Spoofing2 Jun 2025
- 2025FaceShield: Explainable Face Anti-Spoofing with Multimodal Large Language Models14 May 2025
- 2025Learning Unknown Spoof Prompts for Generalized Face Anti-Spoofing Using Only Real Face Images6 May 2025
Similar, not cited
Close in wording, no citation either way
- 2026MS-MFAD : Multimodal large language models for Face Anti-spoofing Detection
- 2023FLIP: Cross-domain Face Anti-spoofing with Language Guidance
- 2025SLIP: Spoof-Aware One-Class Face Anti-Spoofing with Language Image Pretraining
- 2025PA-FAS: Towards Interpretable and Generalizable Multimodal Face Anti-Spoofing via Path-Augmented Reinforcement Learning
- 2026FAS-R1: A Unified Multi-Task MLLM for Reasoning Face Anti-Spoofing
- 2025InstructFLIP: Exploring Unified Vision-Language Model for Face Anti-spoofing
- 2024CFPL-FAS: Class Free Prompt Learning for Generalizable Face Anti-spoofing
- 2025Multi-View Slot Attention Using Paraphrased Texts for Face Anti-Spoofing