A Benchmark Dataset for MLLM-Generated Image Detection: GPT Image2 & Nano Banana2
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
The realism of images generated by multimodal large language models (MLLMs), such as GPT Image2 and Nano Banana2, has improved rapidly in recent years. Compared with early generative models, current models have made clear progress in text rendering. They can produce high-quality images that closely resemble real-world application scenarios. The enhanced generation capabilities of current MLLMs pose increasingly severe challenges to AI-generated image detection. Detection is no longer limited to identifying obvious artifacts left by early generators. Instead, it requires systematic and realistic benchmarks for the new generation of generated content. However, most existing benchmarks are still built around early generative models and cannot fully evaluate the forensic challenges introduced by high-quality and multi-form generated images. To address this gap, this paper constructs a benchmark dataset for detecting images generated by MLLMs. The benchmark covers several realistic application scenarios and adopts three generation protocols to simulate direct generation, reference-based reconstruction, and local editing. Based on this benchmark, we evaluate detector degradation from traditional scenarios to MLLM-generated images and analyze false positive rates and false negative rates across three sample types, revealing the failure modes of existing methods. We further propose a structural-artifact-prior-guided dual-stream prompt framework (SAP-DSP) as a strong baseline. SAP-DSP uses dual-stream prompt learning and structure-aware routing fusion to improve representation learning. Extensive experiments show that the proposed benchmark exposes the performance degradation of existing detectors on high-quality generated images, while SAP-DSP achieves more stable detection results on this benchmark. Our code and dataset are publicly available at https://github.com/xbrainnet/SAP-DSP.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 19 of its 26 references that are in the map. First posted on arXiv 2 Aug 2026.
Builds on
19 of 26 references.
References · 19
- 2022Generative Adversarial Networkscited by 5,603
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2023DIRE for Diffusion-Generated Image Detectioncited by 386
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
- 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 163
- 2020A Survey on Generative Adversarial Networks: Variants, Applications, and Trainingcited by 97
- 2025Bridging the Gap Between Ideal and Real-world Evaluation: Benchmarking AI-Generated Image Detection in Challenging Scenarioscited by 24
7 more
- 2025CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Surveycited by 15
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detectioncited by 10
- 2025Towards Generalizable AI-Generated Image Detection via Image-Adaptive Prompt Learningcited by 8
- 2025Scaling Up AI-Generated Image Detection with Generator-Aware Prototypescited by 8
- 2026PGC: Peak-Guided Calibration for Generalizable AI-Generated Image Detectioncited by 5
- 2026Layer Consistency Matters: Elegant Latent Transition Discrepancy for Generalizable Synthetic Image Detectioncited by 4
- 2026TextFake: Benchmarking AI-Generated Image Detection on Text-Rich Imagescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs
- 2026Generalizable Detection of AI Generated Images with Large Models and Fuzzy Decision Tree
- 2024Harnessing the Power of Large Vision Language Models for Synthetic Image Detection
- 2025Explainable AI-Generated Image Detection RewardBench
- 2025Towards Explainable Fake Image Detection with Multi-Modal Large Language Models
- 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLM
- 2026When Understanding Becomes a Risk: Authenticity and Safety Risks in the Emerging Image Generation Paradigm
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics