mlsanityData to 14 Oct 2026

Epistemic Uncertainty for Generated Image Detection

arXiv 2412.05897 ↗First posted 8 Dec 2024cs.CV cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

We introduce a novel framework for AI-generated image detection through epistemic uncertainty, aiming to address critical security concerns in the era of generative models. Our key insight stems from the observation that distributional discrepancies between training and testing data manifest distinctively in the epistemic uncertainty space of machine learning models. In this context, the distribution shift between natural and generated images leads to elevated epistemic uncertainty in models trained on natural images when evaluating generated ones. Hence, we exploit this phenomenon by using epistemic uncertainty as a proxy for detecting generated images. This converts the challenge of generated image detection into the problem of uncertainty estimation, underscoring the generalization performance of the model used for uncertainty estimation. Fortunately, advanced large-scale vision models pre-trained on extensive natural images have shown excellent generalization performance for various scenarios. Thus, we utilize these pre-trained models to estimate the epistemic uncertainty of images and flag those with high uncertainty as generated. Extensive experiments demonstrate the efficacy of our method. Code is available at https://github.com/tmlr-group/WePe.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 39 of its 55 references that are in the map. First posted on arXiv 8 Dec 2024.

Builds on

39 of 55 references.

References · 39

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  7. 2017On Calibration of Modern Neural Networkscited by 4,960
  8. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  9. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  10. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  11. 2014Going Deeper with Convolutionscited by 4,241
  12. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
27 more
  1. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  2. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  3. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
  4. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  5. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  6. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  7. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  8. 2023DIRE for Diffusion-Generated Image Detectioncited by 390
  9. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  10. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
  11. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  12. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
  13. 2020What makes fake images detectable? Understanding properties that generalizecited by 273
  14. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  15. 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
  16. 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 205
  17. 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
  18. 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
  19. 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
  20. 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
  21. 2021DEUP: Direct Epistemic Uncertainty Predictioncited by 104
  22. 2018Uncertainty in Neural Networks: Approximately Bayesian Ensemblingcited by 94
  23. 2020Masksembles for Uncertainty Estimationcited by 88
  24. 2024Estimating Epistemic and Aleatoric Uncertainty with a Single Modelcited by 54
  25. 2022Detecting GAN-generated Images by Orthogonal Training of Multiple CNNscited by 46
  26. 2024RIGID: A Training-free and Model-Agnostic Framework for Robust AI-Generated Image Detectioncited by 36
  27. 2022Improving Out-of-Distribution Detection via Epistemic Uncertainty Adversarial Trainingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.