Emergent Morphing Attack Detection in Open Multi-modal Large Language Models
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Face morphing attacks threaten biometric verification, yet most morphing attack detection (MAD) systems require task-specific training and generalize poorly to unseen attack types. Meanwhile, open-source multimodal large language models (MLLMs) have demonstrated strong visual-linguistic reasoning, but their potential in biometric forensics remains underexplored. In this paper, we present the first systematic zero-shot evaluation of open-source MLLMs for single-image MAD, using publicly available weights and a standardized, reproducible protocol. Across diverse morphing techniques, many MLLMs show non-trivial discriminative ability without any fine-tuning or domain adaptation, and LLaVA1.6-Mistral-7B achieves state-of-the-art performance, surpassing highly competitive task-specific MAD baselines by at least 23% in terms of equal error rate (EER). The results indicate that multimodal pretraining can implicitly encode fine-grained facial inconsistencies indicative of morphing artifacts, enabling zero-shot forensic sensitivity. Our findings position open-source MLLMs as reproducible, interpretable, and competitive foundations for biometric security and forensic image analysis. This emergent capability also highlights new opportunities to develop state-of-the-art MAD systems through targeted fine-tuning or lightweight adaptation, further improving accuracy and efficiency while preserving interpretability. To support future research, all code and evaluation protocols will be released upon publication.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 24 of its 33 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
24 of 33 references.
Closest ancestors · 4
Same direction, newest first
- 2025Benchmarking Foundation Models for Zero-Shot Biometric Tasks30 May
- 2025Can Multi-modal (reasoning) LLMs work as deepfake detectors?25 Mar
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics21 Mar
- 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models6 Feb
Other references · 20
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Visual Instruction Tuningcited by 7,792
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2023MorDIFF: Recognition Vulnerability and Attack Detectability of Face Morphing Attacks Created by Diffusion Autoencoderscited by 44
- 2021MixFaceNets: Extremely Efficient Face Recognition Networkscited by 36
- 2022SYN-MAD 2022: Competition on Face Morphing Attack Detection Based on Privacy-aware Synthetic Training Datacited by 30
- 2021PW-MAD: Pixel-wise Supervision for Generalized Face Morphing Attack Detectioncited by 29
- 2025FaceXBench: Evaluating Multimodal LLMs on Face Understandingcited by 23
- 2022Unsupervised Face Morphing Attack Detection via Self-paced Anomaly Detectioncited by 16
8 more
- 2021Attention Aware Wavelet-based Detection of Morphed Face Imagescited by 14
- 2025MADation: Face Morphing Attack Detection with Foundation Modelscited by 14
- 2025Generalized Single-Image-Based Morphing Attack Detection Using Deep Representations from Vision Transformercited by 14
- 2023Face Morphing Attack Detection with Denoising Diffusion Probabilistic Modelscited by 12
- 2024Greedy-DiM: Greedy Algorithms for Unreasonably Effective Face Morphscited by 10
- 2022Face Morphing Attacks and Face Image Quality: The Effect of Morphing and the Unsupervised Attack Detection by Qualitycited by 8
- 2025SelfMAD: Enhancing Generalization and Robustness in Morphing Attack Detection via Self-Supervised Learningcited by 7
- 2025Empowering Morphing Attack Detection using Interpretable Image-Text Foundation Modelcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Towards Zero-Shot Differential Morphing Attack Detection with Multimodal Large Language Models
- 2025ChatGPT Encounters Morphing Attack Detection: Zero-Shot MAD with Multi-Modal Large Language Models and General Vision Models
- 2026Enhancing Single-Image Facial Demorphing using Multimodal Large Language Models
- 2025Towards General Visual-Linguistic Face Forgery Detection(V2)
- 2026MS-MFAD : Multimodal large language models for Face Anti-spoofing Detection
- 2025FaceShield: Explainable Face Anti-Spoofing with Multimodal Large Language Models
- 2025In-context Learning of Vision Language Models for Detection of Physical and Digital Attacks against Face Recognition Systems
- 2025StableMorph: High-Quality Face Morph Generation with Stable Diffusion