Autonomous and Self-Adapting System for Synthetic Media Detection and Attribution
Not on the map. Why?
Abstract (arXiv)
Rapid advances in generative AI have enabled the creation of highly realistic synthetic images, which, while beneficial in many domains, also pose serious risks in terms of disinformation, fraud, and other malicious applications. Current synthetic image identification systems are typically static, relying on feature representations learned from known generators; as new generative models emerge, these systems suffer from severe performance degradation. In this paper, we introduce the concept of an autonomous self-adaptive synthetic media identification system -- one that not only detects synthetic images and attributes them to known sources but also autonomously identifies and incorporates novel generators without human intervention. Our approach leverages an open-set identification strategy with an evolvable embedding space that distinguishes between known and unknown sources. By employing an unsupervised clustering method to aggregate unknown samples into high-confidence clusters and continuously refining its decision boundaries, our system maintains robust detection and attribution performance even as the generative landscape evolves. Extensive experiments demonstrate that our method significantly outperforms existing approaches, marking a crucial step toward universal, adaptable forensic systems in the era of rapidly advancing generative models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 47 of its 78 references that are in the map. First posted on arXiv 4 Apr 2025.
Builds on
47 of 78 references.
References · 47
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2016Learning without Forgettingcited by 2,496
35 more
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2016Understanding deep learning requires rethinking generalizationcited by 1,674
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2022On the detection of synthetic images generated by diffusion modelscited by 283
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2018Do GANs leave artificial fingerprints?cited by 190
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
- 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 164
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2019Detecting GAN generated Fake Images using Co-occurrence Matricescited by 124
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
- 2017Accelerated Hierarchical Density Clusteringcited by 102
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
- 2019Incremental learning for the detection and classification of GAN-generated imagescited by 58
- 2024Zero-Shot Detection of AI-Generated Imagescited by 50
- 2020CNN Detection of GAN-Generated Face Images based on Cross-Band Co-occurrences Analysiscited by 42
- 2022RepMix: Representation Mixing for Robust Attribution of Synthesized Imagescited by 39
- 2023Progressive Open Space Expansion for Open-Set Model Attributioncited by 32
- 2023Deep Image Fingerprint: Towards Low Budget Synthetic Image Detection and Model Lineage Analysiscited by 30
- 2024Beyond Deepfake Images: Detecting AI-Generated Videoscited by 22
- 2023Open Set Synthetic Image Source Attributioncited by 12
- 2025Forensic Self-Descriptions Are All You Need for Zero-Shot Detection, Open-Set Source Attribution, and Clustering of AI-generated Imagescited by 11
- 2024E3: Ensemble of Expert Embedders for Adapting Synthetic Image Detectors to New Generators Using Limited Datacited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.