mlsanityData to 14 Oct 2026

Employing Vision-Language Models for Face Image Quality Assessment

arXiv 2605.17489 ↗First posted 17 May 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Social bias and fairness in VLMs

Abstract (arXiv)

Face Image Quality Assessment (FIQA) is a crucial control step in biometric pipelines. It ensures only reliable samples are processed to maintain system accuracy. State-of-the-art FIQA methods achieve high utility but typically operate as "black boxes." They produce scalar scores without human-interpretable justifications. This lack of transparency limits their effectiveness in human-in-the-loop scenarios, such as automated border control, where actionable feedback is essential. In this paper, we investigate the potential of off-the-shelf Vision-Language Models (VLMs) to bridge this gap by performing FIQA in a zero-shot setting. We present a comprehensive evaluation framework for assessing VLM performance. This involves benchmarking traditional FIQA methods through error-versus-reject curves. Additionally, using a diverse set of datasets, ranging from surveillance-oriented to synthetically generated, we analyzed their interpretability, consistency, and robustness to prompt changes. Our results show biometric utility performance depends significantly on architecture, not merely on parameter count. Most VLMs' outputs align with those of traditional methods. We also find that VLM ranking performance and the generated scores may vary across prompts. Our synthetic ablation study shows that while increasing the parameter count can improve internal consistency, it yields worse degradation-detection performance than smaller models. These findings suggest that zero-shot FIQA score estimation using VLMs is promising and could effectively complement conventional FIQA pipelines as an interpretability module. The codes are available at https://github.com/ThEnded32/VLM4FIQA.git.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Social bias and fairness in VLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 33 of its 47 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

33 of 47 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025FaceLLM: A Multimodal Large Language Model for Face Understanding14 Jul

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  6. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  7. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  8. 2024Phi-4 Technical Reportcited by 711
  9. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  10. 2022AdaFace: Quality Adaptive Margin for Face Recognitioncited by 391
  11. 2023OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documentscited by 316
  12. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
20 more
  1. 2020SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustnesscited by 112
  2. 2024Towards Open-ended Visual Quality Comparisoncited by 85
  3. 2020Face Image Quality Assessment: A Literature Surveycited by 80
  4. 2021SDD-FIQA: Unsupervised Face Image Quality Assessment with Similarity Distribution Distancecited by 64
  5. 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
  6. 2022IFQA: Interpretable Face Quality Assessmentcited by 24
  7. 2022FaceQAN: Face Image Quality Assessment Through Adversarial Noise Explorationcited by 18
  8. 2024DSL-FIQA: Assessing Facial Image Quality via Dual-Set Degradation Learning and Landmark-Guided Transformercited by 17
  9. 2025FVQ: A Large-Scale Dataset and an LMM-based Method for Face Video Quality Assessmentcited by 13
  10. 2025LVFace: Progressive Cluster Optimization for Large Vision Models in Face Recognitioncited by 12
  11. 2025Face-LLaVA: Facial Expression and Attribute Understanding through Instruction Tuningcited by 11
  12. 2025ViT-FIQA: Assessing Face Image Quality using Vision Transformerscited by 8
  13. 2024HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understandingcited by 7
  14. 2025FaceShield: Explainable Face Anti-Spoofing with Multimodal Large Language Modelscited by 6
  15. 2025VQualA 2025 Challenge on Face Image Quality Assessment: Methods and Resultscited by 4
  16. 2025InstructFLIP: Exploring Unified Vision-Language Model for Face Anti-spoofingcited by 3
  17. 2025MGFFD-VLM: Multi-Granularity Prompt Learning for Face Forgery Detection with VLMcited by 3
  18. 2024Analyzing the Effect of Combined Degradations on Face Recognitioncited by 2
  19. 2025FaceOracle: Chat with a Face Image Oraclecited by 1
  20. 2025QA-VLM: Providing human-interpretable quality assessment for wire-feed laser additive manufacturing parts with Vision Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Efficient Face Image Quality Assessment via Self-training and Knowledge Distillation
  2. 2026EX-FIQA: Leveraging Intermediate Early eXit Representations from Vision Transformers for Face Image Quality Assessment
  3. 2025Benchmarking Foundation Models for Zero-Shot Biometric Tasks
  4. 2024AI-KD: Towards Alignment Invariant Face Image Quality Assessment Using Knowledge Distillation
  5. 2023DifFIQA: Face Image Quality Assessment Using Denoising Diffusion Probabilistic Models
  6. 2026Benchmarking the Explanatory Quality of Open-Weight Vision-Language Models in Face Recognition
  7. 2026Assessing VLM Reliability for Medical Image Quality Evaluation Under Corruption and Bias
  8. 2025DemoBias: An Empirical Study to Trace Demographic Biases in Vision Foundation Models