mlsanityData to 7 Oct 2026

Interpretable Face Anti-Spoofing: Enhancing Generalization with Multimodal Large Language Models

arXiv 2501.01720 ↗First posted 3 Jan 2025cs.CVcited by 11

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness

Abstract (arXiv)

Face Anti-Spoofing (FAS) is essential for ensuring the security and reliability of facial recognition systems. Most existing FAS methods are formulated as binary classification tasks, providing confidence scores without interpretation. They exhibit limited generalization in out-of-domain scenarios, such as new environments or unseen spoofing types. In this work, we introduce a multimodal large language model (MLLM) framework for FAS, termed Interpretable Face Anti-Spoofing (I-FAS), which transforms the FAS task into an interpretable visual question answering (VQA) paradigm. Specifically, we propose a Spoof-aware Captioning and Filtering (SCF) strategy to generate high-quality captions for FAS images, enriching the model's supervision with natural language interpretations. To mitigate the impact of noisy captions during training, we develop a Lopsided Language Model (L-LM) loss function that separates loss calculations for judgment and interpretation, prioritizing the optimization of the former. Furthermore, to enhance the model's perception of global visual features, we design a Globally Aware Connector (GAC) to align multi-level visual representations with the language model. Extensive experiments on standard and newly devised One to Eleven cross-domain benchmarks, comprising 12 public datasets, demonstrate that our method significantly outperforms state-of-the-art methods.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 4 of its 60 references that are in the map. First posted on arXiv 3 Jan 2025.

Builds on

4 of 60 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models6 Feb

Other references · 3

  1. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  2. 2023From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Modelscited by 96
  3. 2024An empirical study of LLaMA3 quantization: from LLMs to MLLMscited by 63

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 8.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MS-MFAD : Multimodal large language models for Face Anti-spoofing Detection
  2. 2023FLIP: Cross-domain Face Anti-spoofing with Language Guidance
  3. 2025SLIP: Spoof-Aware One-Class Face Anti-Spoofing with Language Image Pretraining
  4. 2025PA-FAS: Towards Interpretable and Generalizable Multimodal Face Anti-Spoofing via Path-Augmented Reinforcement Learning
  5. 2026FAS-R1: A Unified Multi-Task MLLM for Reasoning Face Anti-Spoofing
  6. 2025InstructFLIP: Exploring Unified Vision-Language Model for Face Anti-spoofing
  7. 2024CFPL-FAS: Class Free Prompt Learning for Generalizable Face Anti-spoofing
  8. 2025Multi-View Slot Attention Using Paraphrased Texts for Face Anti-Spoofing