mlsanityData to 14 Oct 2026

FPBench: A Comprehensive Benchmark of Multimodal Large Language Models for Fingerprint Analysis

arXiv 2512.18073 ↗First posted 19 Dec 2025cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness

Abstract (arXiv)

Multimodal LLMs (MLLMs) are capable of performing complex data analysis, visual question answering, generation, and reasoning tasks. However, their ability to analyze biometric data is relatively underexplored. In this work, we investigate the effectiveness of MLLMs in understanding fine structural and textural details present in fingerprint images. To this end, we design a comprehensive benchmark, FPBench, to evaluate 20 MLLMs (open-source and proprietary models) across 7 real and synthetic datasets on a suite of 8 biometric and forensic tasks (e.g., pattern analysis, fingerprint verification, real versus synthetic classification, etc.) using zero-shot and chain-of-thought prompting strategies. We further fine-tune vision and language encoders on a subset of open-source MLLMs to demonstrate domain adaptation. FPBench is a novel benchmark designed as a first step towards developing foundation models in fingerprints. Our findings indicate fine-tuning of vision and language encoders improves the performance by 7%-39%. Our codes are available at https://github.com/Ektagavas/FPBench.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 47 of its 65 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

47 of 65 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Benchmarking Foundation Models for Zero-Shot Biometric Tasks30 May
  2. 2024ChatGPT Meets Iris Biometrics9 Aug
  3. 2024SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models6 Feb

Other references · 44

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  7. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  8. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  9. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  10. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  11. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  12. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
32 more
  1. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  2. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  3. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  4. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
  5. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  6. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
  7. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  8. 2023A Survey on Multimodal Large Language Modelscited by 909
  9. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  10. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  11. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
  12. 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 357
  13. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
  14. 2024What matters when building vision-language models?cited by 326
  15. 2023OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documentscited by 316
  16. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 256
  17. 2024A Comprehensive Review of Multimodal Large Language Models: Performance and Challenges Across Different Taskscited by 57
  18. 2019Learning a Fixed-Length Fingerprint Representationcited by 49
  19. 2021Document Collection Visual Question Answeringcited by 45
  20. 2017FingerNet: An Unified Deep Network for Fingerprint Minutiae Extractioncited by 36
  21. 2023Learn to Refuse: Making Large Language Models More Controllable and Reliable through Knowledge Scope Limitation and Refusal Mechanismcited by 33
  22. 2024EMO-LLaMA: Enhancing Facial Emotion Understanding with Instruction Tuningcited by 28
  23. 2025FaceXBench: Evaluating Multimodal LLMs on Face Understandingcited by 24
  24. 2024MedBench: A Comprehensive, Standardized, and Reliable Benchmarking System for Evaluating Chinese Medical Large Language Modelscited by 21
  25. 2025Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectivescited by 18
  26. 2025FaceLLM: A Multimodal Large Language Model for Face Understandingcited by 15
  27. 2017Robust Minutiae Extractor: Integrating Deep Networks and Fingerprint Domain Knowledgecited by 13
  28. 2024Face-MLLM: A Large Face Perception Modelcited by 13
  29. 2024Universal Fingerprint Generation: Controllable Diffusion Model with Multimodal Conditionscited by 10
  30. 2020Fingerprint Feature Extraction by Combining Texture, Minutiae, and Frequency Spectrum Using Multi-Task CNNcited by 7
  31. 2022Transformer based Fingerprint Feature Extractioncited by 7
  32. 2024Enhancement-Driven Pretraining for Robust Fingerprint Representation Learningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026SLAPBench: Benchmarking Multimodal Large Language Models for Four-Finger SLAP Fingerprint Verificationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Emergent Morphing Attack Detection in Open Multi-modal Large Language Models
  2. 2025Safe-LLaVA: A Privacy-Preserving Vision-Language Dataset and Benchmark for Biometric Safety
  3. 2025FPEdit: Robust LLM Fingerprinting through Localized Parameter Editing
  4. 2025PATFinger: Prompt-Adapted Transferable Fingerprinting against Unauthorized Multimodal Dataset Usage
  5. 2025Training-Free Personalization via Retrieval and Reasoning on Fingerprints
  6. 2026Fingerprinting Multimodal Large Language Models
  7. 2026ForensicZoom: Adaptive Visual Inspection with Multimodal LLMs for Industrial-Grade Face Forgery Detection
  8. 2025RAFP: Identifying LLM Lineages via Rare-Region Fingerprints