# ChatGPT Meets Iris Biometrics

arXiv: https://arxiv.org/abs/2408.04868 · HTML: https://mlsanity.com/paper/2408.04868/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models.
- Builds on 15 of its 37 references that are in the map.
- First posted on arXiv 9 Aug 2024.

## Placed in

- Multimodal LLMs / vision-language models / [MLLM jailbreaks and adversarial robustness](https://mlsanity.com/mllm/mllm-jailbreaks-and-adversarial-robustness/)

## Builds on (most cited first, 15 of 15)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Language Models are Few-Shot Learners](https://mlsanity.com/paper/2005.14165/) (2020)
- [GPT-4 Technical Report](https://mlsanity.com/paper/2303.08774/) (2023)
- [LLaMA: Open and Efficient Foundation Language Models](https://mlsanity.com/paper/2302.13971/) (2023)
- [PaLM: Scaling Language Modeling with Pathways](https://mlsanity.com/paper/2204.02311/) (2022)
- [A Survey of Large Language Models](https://mlsanity.com/paper/2303.18223/) (2023)
- [PaLM 2 Technical Report](https://mlsanity.com/paper/2305.10403/) (2023)
- [Gemini: A Family of Highly Capable Multimodal Models](https://mlsanity.com/paper/2312.11805/) (2023)
- [Capabilities of GPT-4 on Medical Challenge Problems](https://mlsanity.com/paper/2303.13375/) (2023)
- [A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications](https://mlsanity.com/paper/2402.07927/) (2024)
- [DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4](https://mlsanity.com/paper/2303.11032/) (2023)
- [The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues](https://mlsanity.com/paper/2205.07540/) (2022)
- [Can GPT-4V(ision) Serve Medical Applications? Case Studies on GPT-4V for Multimodal Medical Diagnosis](https://mlsanity.com/paper/2310.09909/) (2023)
- [ChatGPT and biometrics: an assessment of face recognition, gender detection, and age estimation capabilities](https://mlsanity.com/paper/2403.02965/) (2024)
- [A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models](https://mlsanity.com/paper/2307.12980/) (2023)

## Built on by (most cited first, 14 of 14)

- [Benchmarking Foundation Models for Zero-Shot Biometric Tasks](https://mlsanity.com/paper/2505.24214/) (2025)
- [Exploring ChatGPT for Face Presentation Attack Detection in Zero and Few-Shot in-Context Learning](https://mlsanity.com/paper/2501.08799/) (2025)
- [Foundation versus Domain-specific Models: Performance Comparison, Fusion, and Explainability in Face Recognition](https://mlsanity.com/paper/2507.03541/) (2025)
- [Towards Iris Presentation Attack Detection with Foundation Models](https://mlsanity.com/paper/2501.06312/) (2025)
- [Evaluating Multimodal Large Language Models for Heterogeneous Face Recognition](https://mlsanity.com/paper/2601.15406/) (2026)
- [MADPromptS: Unlocking Zero-Shot Morphing Attack Detection with Multiple Prompt Aggregation](https://mlsanity.com/paper/2508.08939/) (2025)
- [Human Re-ID Meets LVLMs: What can we expect?](https://mlsanity.com/paper/2501.18698/) (2025)
- [FPBench: A Comprehensive Benchmark of Multimodal Large Language Models for Fingerprint Analysis](https://mlsanity.com/paper/2512.18073/) (2025)
- [ChatGPT Encounters Morphing Attack Detection: Zero-Shot MAD with Multi-Modal Large Language Models and General Vision Models](https://mlsanity.com/paper/2503.10937/) (2025)
- [In-context Learning of Vision Language Models for Detection of Physical and Digital Attacks against Face Recognition Systems](https://mlsanity.com/paper/2507.15285/) (2025)
- [Can Foundation Models Predict Fitness for Duty?](https://mlsanity.com/paper/2507.20418/) (2025)
- [Trade-offs in Cross-Domain Generalization of Foundation Model Fine-Tuned for Biometric Applications](https://mlsanity.com/paper/2509.14921/) (2025)
- [Generalist Multimodal LLMs Gain Biometric Expertise via Human Salience](https://mlsanity.com/paper/2603.17173/) (2026)
- [Multimodal Models Meet Presentation Attack Detection on ID Documents](https://mlsanity.com/paper/2603.29422/) (2026)

## Abstract (arXiv)

This study utilizes the advanced capabilities of the GPT-4 multimodal Large Language Model (LLM) to explore its potential in iris recognition - a field less common and more specialized than face recognition. By focusing on this niche yet crucial area, we investigate how well AI tools like ChatGPT can understand and analyze iris images. Through a series of meticulously designed experiments employing a zero-shot learning approach, the capabilities of ChatGPT-4 was assessed across various challenging conditions including diverse datasets, presentation attacks, occlusions such as glasses, and other real-world variations. The findings convey ChatGPT-4's remarkable adaptability and precision, revealing its proficiency in identifying distinctive iris features, while also detecting subtle effects like makeup on iris recognition. A comparative analysis with Gemini Advanced - Google's AI model - highlighted ChatGPT-4's better performance and user experience in complex iris analysis tasks. This research not only validates the use of LLMs for specialized biometric applications but also emphasizes the importance of nuanced query framing and interaction design in extracting significant insights from biometric data. Our findings suggest a promising path for future research and the development of more adaptable, efficient, robust and interactive biometric security solutions.