Enhancing Single-Image Facial Demorphing using Multimodal Large Language Models
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Face recognition systems are increasingly vulnerable to morphing attacks, where a composite image is crafted to match multiple identities, enabling unauthorized access and identity fraud. Existing detection methods identify morphed images but cannot recover constituent images or identities, limiting their forensic utility. This paper presents a novel reference-free facial demorphing framework that leverages Multimodal Large Language Models (MLLMs) to guide a coupled diffusion-based reconstruction process. Our key innovation lies in extracting semantic embeddings from intermediate MLLM layers to condition the demorphing, providing high-level reasoning about facial attributes and identity cues that complement low-level pixel information. We formulate demorphing as a coupled conditional generation problem, where both constituent faces are synthesized jointly through a denoising diffusion model operating directly in the RGB domain, ensuring inter-identity consistency while preserving fine-grained perceptual details. Unlike prior approaches that rely on compressed latent representations or assume identity overlap between training and testing sets, our method bypasses lossy text generation-reencoding cycles by directly utilizing MLLM hidden states as conditioning signals, enabling the denoising network to attend to subtle visual cues such as hair, background, and facial textures. Ablation studies further reveal that middle MLLM layers encode more identity-discriminative representations, RGB-domain demorphing outperforms latent-space approaches by 30--40% at strict operating points, and full MLLM embeddings provide substantial advantages over raw ViT features through enhanced semantic structuring from multimodal pretraining.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 41 of its 74 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
41 of 74 references.
References · 41
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Visual Instruction Tuningcited by 7,869
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
29 more
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
- 2014Learning Face Representation from Scratchcited by 453
- 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2021ElasticFace: Elastic Margin Loss for Deep Face Recognitioncited by 144
- 2022Privacy-friendly Synthetic Data for the Development of Face Morphing Attack Detectorscited by 47
- 2020Can GAN Generated Morphs Threaten Face Recognition Systems Equally as Landmark Based Morphs? -- Vulnerability and Detectioncited by 46
- 2023MorDIFF: Recognition Vulnerability and Attack Detectability of Face Morphing Attacks Created by Diffusion Autoencoderscited by 44
- 2022SYN-MAD 2022: Competition on Face Morphing Attack Detection Based on Privacy-aware Synthetic Training Datacited by 30
- 2021PW-MAD: Pixel-wise Supervision for Generalized Face Morphing Attack Detectioncited by 29
- 2022Unsupervised Face Morphing Attack Detection via Self-paced Anomaly Detectioncited by 16
- 2019Robust Morph-Detection at Automated Border Control Gate using Deep Decomposed 3D Shape and Diffuse Reflectancecited by 15
- 202550 Years of Automated Face Recognitioncited by 15
- 2025MADation: Face Morphing Attack Detection with Foundation Modelscited by 14
- 2025Generalized Single-Image-Based Morphing Attack Detection Using Deep Representations from Vision Transformercited by 14
- 2023Face Morphing Attack Detection with Denoising Diffusion Probabilistic Modelscited by 12
- 2022OrthoMAD: Morphing Attack Detection Through Orthogonal Identity Disentanglementcited by 10
- 2022Facial De-morphing: Extracting Component Faces from a Single Morphcited by 9
- 2023Unveiling the Two-Faced Truth: Disentangling Morphed Identities for Face Morphing Detectioncited by 9
- 2024LADIMO: Face Morph Generation through Biometric Template Inversion with Latent Diffusioncited by 9
- 2024Facial Demorphing via Identity Preserving Image Decompositioncited by 8
- 2023SDeMorph: Towards Better Facial De-morphing from Single Morphcited by 6
- 2024dc-GAN: Dual-Conditioned GAN for Face Demorphing From a Single Morphcited by 6
- 2023MorphGANFormer: Transformer-based Face Morphing and De-Morphingcited by 4
- 2025FLOWING: Implicit Neural Flows for Structure-Preserving Morphingcited by 3
- 2025Metric for Evaluating Performance of Reference-Free Demorphing Methodscited by 2
- 2025diffDemorph: Extending Reference-Free Demorphing to Unseen Facescited by 1
- 2025Facial Demorphing from a Single Morph Using a Latent Conditional GANcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DCMorph: Face Morphing via Dual-Stream Cross-Attention Diffusion
- 2026Emergent Morphing Attack Detection in Open Multi-modal Large Language Models
- 2025StableMorph: High-Quality Face Morph Generation with Stable Diffusion
- 2026When Diffusion Models Forget Who You Are: Identity Preservation in Face Inpainting under Large Occlusions
- 2025FaceLLM: A Multimodal Large Language Model for Face Understanding
- 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models
- 2026Foundation and Multimodal Large Language Models for Face Presentation and Morph Attack Detection
- 2023Controllable Inversion of Black-Box Face Recognition Models via Diffusion