mlsanityData to 14 Oct 2026

AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detection

arXiv 2504.20865 ↗First posted 29 Apr 2025cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

The rapid advancement of generative AI has revolutionized image creation, enabling high-quality synthesis from text prompts while raising critical challenges for media authenticity. We present Ai-GenBench, a novel benchmark designed to address the urgent need for robust detection of AI-generated images in real-world scenarios. Unlike existing solutions that evaluate models on static datasets, Ai-GenBench introduces a temporal evaluation framework where detection methods are incrementally trained on synthetic images, historically ordered by their generative models, to test their ability to generalize to new generative models, such as the transition from GANs to diffusion models. Our benchmark focuses on high-quality, diverse visual content and overcomes key limitations of current approaches, including arbitrary dataset splits, unfair comparisons, and excessive computational demands. Ai-GenBench provides a comprehensive dataset, a standardized evaluation protocol, and accessible tools for both researchers and non-experts (e.g., journalists, fact-checkers), ensuring reproducibility while maintaining practical training requirements. By establishing clear evaluation rules and controlled augmentation strategies, Ai-GenBench enables meaningful comparison of detection methods and scalable solutions. Code and data are publicly available to ensure reproducibility and to support the development of robust forensic detectors to keep pace with the rise of new synthetic generators.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 56 of its 69 references that are in the map. First posted on arXiv 29 Apr 2025.

Builds on

56 of 69 references.

References · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  11. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  12. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
38 more
  1. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  2. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  3. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  4. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  5. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  6. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  7. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
  8. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  9. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  10. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 516
  11. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  12. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
  13. 2022On the detection of synthetic images generated by diffusion modelscited by 283
  14. 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
  15. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
  16. 2021Projected GANs Converge Fastercited by 208
  17. 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
  18. 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
  19. 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 126
  20. 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
  21. 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 123
  22. 2021Generative Adversarial Transformerscited by 120
  23. 2022Towards the Detection of Diffusion Model Deepfakescited by 111
  24. 2020Image Generators with Conditionally-Independent Pixel Synthesiscited by 106
  25. 2023Art and the science of generative AI: A deeper divecited by 95
  26. 2023Identifying and Mitigating the Security Risks of Generative AIcited by 91
  27. 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
  28. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
  29. 2024A Bias-Free Training Paradigm for More General AI-generated Image Detectioncited by 67
  30. 2023Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Imagescited by 66
  31. 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
  32. 2024FakeInversion: Learning to Detect Images from Unseen Text-to-Image Models by Inverting Stable Diffusioncited by 61
  33. 2018Diverse Image Synthesis from Semantic Layouts via Conditional IMLEcited by 60
  34. 2023Online Detection of AI-Generated Imagescited by 55
  35. 2022A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentialscited by 45
  36. 2024Diffusion Facial Forgery Detectioncited by 41
  37. 2023ArtiFact: A Large-Scale Dataset with Artificial and Factual Images for Generalizable and Robust Synthetic Image Detectioncited by 35
  38. 2024WildFake: A Large-scale Challenging Dataset for AI-Generated Images Detectioncited by 31

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 8.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?
  2. 2024The Visual Counter Turing Test (VCT2): A Benchmark for Evaluating AI-Generated Image Detection and the Visual AI Index (VAI)
  3. 2026GenSyn10: A Multi-Generative AI Dataset For Benchmarking Image Classification
  4. 2025SFLD: Reducing the content bias for AI-generated Image Detection
  5. 2026GenVideoLens: Where LVLMs Fall Short in AI-Generated Video Detection?
  6. 2026A Comprehensive Dataset for Human vs. AI Generated Image Detection
  7. 2025Methods and Trends in Detecting AI-Generated Images: A Comprehensive Review
  8. 2026Findings of the Counter Turing Test: AI-Generated Image Detection