AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detection
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of generative AI has revolutionized image creation, enabling high-quality synthesis from text prompts while raising critical challenges for media authenticity. We present Ai-GenBench, a novel benchmark designed to address the urgent need for robust detection of AI-generated images in real-world scenarios. Unlike existing solutions that evaluate models on static datasets, Ai-GenBench introduces a temporal evaluation framework where detection methods are incrementally trained on synthetic images, historically ordered by their generative models, to test their ability to generalize to new generative models, such as the transition from GANs to diffusion models. Our benchmark focuses on high-quality, diverse visual content and overcomes key limitations of current approaches, including arbitrary dataset splits, unfair comparisons, and excessive computational demands. Ai-GenBench provides a comprehensive dataset, a standardized evaluation protocol, and accessible tools for both researchers and non-experts (e.g., journalists, fact-checkers), ensuring reproducibility while maintaining practical training requirements. By establishing clear evaluation rules and controlled augmentation strategies, Ai-GenBench enables meaningful comparison of detection methods and scalable solutions. Code and data are publicly available to ensure reproducibility and to support the development of robust forensic detectors to keep pace with the rise of new synthetic generators.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 56 of its 69 references that are in the map. First posted on arXiv 29 Apr 2025.
Builds on
56 of 69 references.
References · 56
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
38 more
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2022On the detection of synthetic images generated by diffusion modelscited by 283
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
- 2021Projected GANs Converge Fastercited by 208
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 126
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 123
- 2021Generative Adversarial Transformerscited by 120
- 2022Towards the Detection of Diffusion Model Deepfakescited by 111
- 2020Image Generators with Conditionally-Independent Pixel Synthesiscited by 106
- 2023Art and the science of generative AI: A deeper divecited by 95
- 2023Identifying and Mitigating the Security Risks of Generative AIcited by 91
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
- 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
- 2024A Bias-Free Training Paradigm for More General AI-generated Image Detectioncited by 67
- 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 66
- 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
- 2024FakeInversion: Learning to Detect Images from Unseen Text-to-Image Models by Inverting Stable Diffusioncited by 61
- 2018Diverse Image Synthesis from Semantic Layouts via Conditional IMLEcited by 60
- 2023Online Detection of AI-Generated Imagescited by 55
- 2022A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentialscited by 45
- 2024Diffusion Facial Forgery Detectioncited by 41
- 2023ArtiFact: A Large-Scale Dataset with Artificial and Factual Images for Generalizable and Robust Synthetic Image Detectioncited by 35
- 2024WildFake: A Large-scale Challenging Dataset for AI-Generated Images Detectioncited by 31
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 8.
10 papers.
- 2026How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark studycited by 15
- 2025Generalized Design Choices for Deepfake Detectorscited by 2
- 2026A Benchmark Dataset for MLLM-Generated Image Detection: GPT Image2 & Nano Banana2cited by 2
- 2025Detecting Localized Deepfakes: How Well Do Synthetic Image Detectors Handle Inpainting?cited by 0
- 2026Automated In-the-Wild Data Collection for Continual AI Generated Image Detectioncited by 0
- 2026SPECTRA-Net: Scalable Pipeline for Explainable Cross-domain Tensor Representations for AI-generated Images Detectioncited by 0
- 2026VendorBench-100: A Unified Cross-Paradigm Benchmark for Deepfake Image Detectioncited by 0
- 2026Continuously Evolving Deepfake Detection: An Architecture and Public-Benchmark Evaluation of a Dynamic Detection Systemcited by 0
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detectioncited by 0
- 2026Trustworthy synthetic visual media: Evidence across the media lifecyclecited by 0
- 2026Trustworthy synthetic visual media: Evidence across the media lifecycle28 Sep 2026
- 2026REALIS: A Curated Dataset for Studying the Challenges of AI Image Detection26 Sep 2026
- 2026A Benchmark Dataset for MLLM-Generated Image Detection: GPT Image2 & Nano Banana22 Aug 2026
- 2026Continuously Evolving Deepfake Detection: An Architecture and Public-Benchmark Evaluation of a Dynamic Detection System14 Jul 2026
- 2026VendorBench-100: A Unified Cross-Paradigm Benchmark for Deepfake Image Detection7 Jul 2026
- 2026SPECTRA-Net: Scalable Pipeline for Explainable Cross-domain Tensor Representations for AI-generated Images Detection6 May 2026
- 2026Automated In-the-Wild Data Collection for Continual AI Generated Image Detection4 May 2026
- 2026How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark study8 Feb 2026
- 2025Detecting Localized Deepfakes: How Well Do Synthetic Image Detectors Handle Inpainting?18 Dec 2025
- 2025Generalized Design Choices for Deepfake Detectors26 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?
- 2024The Visual Counter Turing Test (VCT2): A Benchmark for Evaluating AI-Generated Image Detection and the Visual AI Index (VAI)
- 2026GenSyn10: A Multi-Generative AI Dataset For Benchmarking Image Classification
- 2025SFLD: Reducing the content bias for AI-generated Image Detection
- 2026GenVideoLens: Where LVLMs Fall Short in AI-Generated Video Detection?
- 2026A Comprehensive Dataset for Human vs. AI Generated Image Detection
- 2025Methods and Trends in Detecting AI-Generated Images: A Comprehensive Review
- 2026Findings of the Counter Turing Test: AI-Generated Image Detection