Epistemic Uncertainty for Generated Image Detection
Not on the map. Why?
Abstract (arXiv)
We introduce a novel framework for AI-generated image detection through epistemic uncertainty, aiming to address critical security concerns in the era of generative models. Our key insight stems from the observation that distributional discrepancies between training and testing data manifest distinctively in the epistemic uncertainty space of machine learning models. In this context, the distribution shift between natural and generated images leads to elevated epistemic uncertainty in models trained on natural images when evaluating generated ones. Hence, we exploit this phenomenon by using epistemic uncertainty as a proxy for detecting generated images. This converts the challenge of generated image detection into the problem of uncertainty estimation, underscoring the generalization performance of the model used for uncertainty estimation. Fortunately, advanced large-scale vision models pre-trained on extensive natural images have shown excellent generalization performance for various scenarios. Thus, we utilize these pre-trained models to estimate the epistemic uncertainty of images and flag those with high uncertainty as generated. Extensive experiments demonstrate the efficacy of our method. Code is available at https://github.com/tmlr-group/WePe.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 39 of its 55 references that are in the map. First posted on arXiv 8 Dec 2024.
Builds on
39 of 55 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2014Going Deeper with Convolutionscited by 4,241
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
27 more
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2022Extremely Simple Activation Shaping for Out-of-Distribution Detectioncited by 212
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 205
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2021DICE: Leveraging Sparsification for Out-of-Distribution Detectioncited by 166
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
- 2021DEUP: Direct Epistemic Uncertainty Predictioncited by 104
- 2018Uncertainty in Neural Networks: Approximately Bayesian Ensemblingcited by 94
- 2020Masksembles for Uncertainty Estimationcited by 88
- 2024Estimating Epistemic and Aleatoric Uncertainty with a Single Modelcited by 54
- 2022Detecting GAN-generated Images by Orthogonal Training of Multiple CNNscited by 46
- 2024RIGID: A Training-free and Model-Agnostic Framework for Robust AI-Generated Image Detectioncited by 36
- 2022Improving Out-of-Distribution Detection via Epistemic Uncertainty Adversarial Trainingcited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Fully AI-Generated Image Detection: Definition, Recent Advances and Challengescited by 4
- 2026Perturbation-Based Epistemic Uncertainty for Failure Detection in Vision-Language-Action Modelscited by 0
- 2026Generated Images Are Easier to Forget: A Machine Unlearning Perspective for Synthetic Image Detectioncited by 0
- 2026Generated Images Are Easier to Forget: A Machine Unlearning Perspective for Synthetic Image Detection1 Aug 2026
- 2026Perturbation-Based Epistemic Uncertainty for Failure Detection in Vision-Language-Action Models18 Jun 2026
- 2025Fully AI-Generated Image Detection: Definition, Recent Advances and Challenges27 Feb 2025