mlsanityData to 14 Oct 2026

ChatGPT Images 2.5 in the Wild: A Launch-Period Dataset and Detector Evaluation

arXiv 2609.15100 ↗First posted 14 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

An image tool can change its underlying generator while retaining its public name, making version attribution from online posts ambiguous. We study this problem after the ChatGPT Images 2.5 launch. Our frozen collection contains 3,478 images from 2,440 posts across 8 sources. Recorded posting times fall within the first 51.1 hours after the announcement. It records three attribution tiers and retains standalone images after image-form filtering and targeted review. Caption claims and host records provide admission evidence, not independently verified generator identity. The observed content profile depends on the source mixture: NightCafe supplies 39.0% of images but 77.0% of CLIP-assigned fantasy scenes. We then evaluate six frozen detectors at thresholds calibrated to a 5% flag rate on reference photographs. Collection flag rates range from 3.7 to 56.4%, falling 42-81 percentage points below GenImage recall. Held-out artwork false-positive rates range from 1.5 to 96.5%, so a higher collection flag rate does not by itself establish better detection. An exploratory X-only comparison with our April collection finds a higher September flag rate for Effort, and a suggestive difference for DoU, under fixed-threshold post-clustered bootstrap intervals. Attribution, content and processing differences prevent a causal interpretation of these contrasts. The collection supports analysis of reported model use during a product transition, with source and attribution evidence retained for interpretation. The collection is released at https://scam.ai/research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

27 of 36 references.

References · 27

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  3. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  4. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
  5. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
  6. 2021Are GAN generated images easy to detect? A critical analysis of the state-of-the-artcited by 139
  7. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
  8. 2024A Bias-Free Training Paradigm for More General AI-generated Image Detectioncited by 67
  9. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58
  10. 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
  11. 2024AMMeBa: A Large-Scale Survey and Dataset of Media-Based Misinformation In-The-Wildcited by 27
  12. 2025An Empirical Study of GPT-4o Image Generation Capabilitiescited by 26
15 more
  1. 2025Bridging the Gap Between Ideal and Real-world Evaluation: Benchmarking AI-Generated Image Detection in Challenging Scenarioscited by 24
  2. 2026How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark studycited by 15
  3. 2025Can Multi-modal (reasoning) LLMs work as deepfake detectors?cited by 14
  4. 2025Do Deepfake Detectors Work in Reality?cited by 11
  5. 2025Navigating the Challenges of AI-Generated Image Detection in the Wild: What Truly Matters?cited by 10
  6. 2024Examining the Prevalence and Dynamics of AI-Generated Media in Art Subredditscited by 8
  7. 2025TrueFake: A Real World Case Dataset of Last Generation Fake Images also Shared on Social Networkscited by 8
  8. 2026GPT-Image-2 in the Wild: A Twitter Dataset of Self-Reported AI-Generated Images from the First Week of Deploymentcited by 8
  9. 2025Synthetic Politics: Prevalence, Spreaders, and Emotional Reception of AI-Generated Political Images on Xcited by 6
  10. 2026PGC: Peak-Guided Calibration for Generalizable AI-Generated Image Detectioncited by 6
  11. 2026Where Detectors Fail: Probing Generative Space for Generalizable AI-Generated Image Detectioncited by 5
  12. 2026GPT4o-Receipt: A Dataset and Human Study for AI-Generated Document Forensicscited by 4
  13. 2026TextRich: A Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2cited by 2
  14. 2026A Benchmark Dataset for MLLM-Generated Image Detection: GPT Image2 & Nano Banana2cited by 2
  15. 2026ChatGPT Images 2.5 on Forgery Tasks: Testing Advertised Improvements Against Known Answerscited by 2

Built on by

Not cited yet.