mlsanityData to 14 Oct 2026

Fusion Under Component Failure: Negative Results and Failure Modes in Ensemble AI-Generated Image Detection

arXiv 2609.31749 ↗First posted 23 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We built an ordinary stacking ensemble for AI-generated image detection -- three open detectors producing five scores, fused by a gradient-boosted meta-learner that treats a detector's failure as missing data -- deployed it, and then evaluated it against three controls it should have faced first. This paper reports what the controls found, including where they overturned our own earlier conclusions. Fusion is worth its cost only when refitted on the target domain. The shipped meta-learner, fitted on a separate corpus, does not beat its best single member on 2000 StyleGAN faces (AUC 0.9896 vs 0.9961; McNemar p = 1.000). But a stacker refitted in-domain beats that member plus a post-hoc calibrator (Delta-AUC = +0.0025, [+0.0014, +0.0038]; p = 3.4e-4). An earlier draft claimed the calibrated single detector won outright; that comparison mixed regimes and we correct it here. One corpus is not an evaluation. On 80 screenshots every model's AUC interval contains 0.5. We can say nothing stronger: the difference between the ensemble's drop and its best member's is [-0.185, +0.115]. Abstention is real, correlated, and mishandled. With four of five detectors silent and the survivor reporting "real", the system returns P(AI) = 0.9985, because an all-NaN input scores 0.9995 in a learner never fitted with missingness. The three AIDE checkpoints fail together, sharing one preprocessing path. A quorum rule requiring two distinct architectures prevents both failures with no retraining. We also find Corpus A carries a class-conditional JPEG bias severe enough to separate the classes from the header alone, which limits every in-domain number we report. Code, harness, hash-identified artifacts and all corrections are released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

14 of 25 references.

References · 14

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2017On Calibration of Modern Neural Networkscited by 4,960
  6. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  7. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  8. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
  9. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  10. 2024Fake or JPEG? Revealing Common Biases in Generated Image Detection Datasetscited by 43
  11. 2025SynthID-Image: Image watermarking at internet scalecited by 31
  12. 2024AI-generated Image Detection: Passive or Watermark?cited by 7
2 more
  1. 2025RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectorscited by 4
  2. 2025Fit for Purpose? Deepfake Detection in the Real Worldcited by 4

Built on by

Not cited yet.