How Noise Benefits AI-generated Image Detection
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of generative models has made real and synthetic images increasingly indistinguishable. Although extensive efforts have been devoted to detecting AI-generated images, out-of-distribution generalization remains a persistent challenge. We trace this weakness to spurious shortcuts exploited during training and we also observe that small feature-space perturbations can mitigate shortcut dominance. To address this problem in a more controllable manner, we propose the Positive-Incentive Noise for CLIP (PiN-CLIP), which jointly trains a noise generator and a detection network under a variational positive-incentive principle. Specifically, we construct positive-incentive noise in the feature space via cross-attention fusion of visual and categorical semantic features. During optimization, the noise is injected into the feature space to fine-tune the visual encoder, suppressing shortcut-sensitive directions while amplifying stable forensic cues, thereby enabling the extraction of more robust and generalized artifact representations. Comparative experiments are conducted on an open-world dataset comprising synthetic images generated by 42 distinct generative models. Our method achieves new state-of-the-art performance, with notable improvements of 5.4 in average accuracy over existing approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 69 of its 90 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
69 of 90 references.
References · 69
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
38 more
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 489
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2023DIRE for Diffusion-Generated Image Detectioncited by 386
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 253
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2024A Sanity Check for AI-generated Image Detectioncited by 187
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 180
- 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 163
- 2020Better Fine-Tuning by Reducing Representational Collapsecited by 156
- 2021StyleSwin: Transformer-based GAN for High-resolution Image Generationcited by 152
- 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 119
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 111
- 2024Low-Rank Few-Shot Adaptation of Vision-Language Modelscited by 103
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 88
- 2024Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspectivecited by 88
- 2017Data Noising as Smoothing in Neural Network Language Modelscited by 78
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024A Bias-Free Training Paradigm for More General AI-generated Image Detectioncited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2024FakeInversion: Learning to Detect Images from Unseen Text-to-Image Models by Inverting Stable Diffusioncited by 61
50 most cited of 69 All 69 (JSON)
Built on by
Not cited yet.