FeatDistill: A Feature Distillation Enhanced Multi-Expert Ensemble Framework for Robust AI-generated Image Detection
Not on the map. Why?
Abstract (arXiv)
The rapid iteration and widespread dissemination of deepfake technology have posed severe challenges to information security, making robust and generalizable detection of AI-generated forged images increasingly important. In this paper, we propose FeatDistill, an AI-generated image detection framework that integrates feature distillation with a multi-expert ensemble, developed for the NTIRE Challenge on Robust AI-Generated Image Detection in the Wild. The framework explicitly targets three practical bottlenecks in real-world forensics: degradation interference, insufficient feature representation, and limited generalization. Concretely, we build a four-backbone Vision Transformer (ViT) ensemble composed of CLIP and SigLIP variants to capture complementary forensic cues. To improve data coverage, we expand the training set and introduce comprehensive degradation modeling, which exposes the detector to diverse quality variations and synthesis artifacts commonly encountered in unconstrained scenarios. We further adopt a two-stage training paradigm: the model is first optimized with a standard binary classification objective, then refined by dense feature-level self-distillation for representation alignment. This design effectively mitigates overfitting and enhances semantic consistency of learned features. At inference time, the final prediction is obtained by averaging the probabilities from four independently trained experts, yielding stable and reliable decisions across unseen generators and complex degradations. Despite the ensemble design, the framework remains efficient, requiring only about 10 GB peak GPU memory. Extensive evaluations in the NTIRE challenge setting demonstrate that FeatDistill achieves strong robustness and generalization under diverse ``in-the-wild'' conditions, offering an effective and practical solution for real-world deepfake image detection.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 34 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
26 of 34 references.
References · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 897
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2023DIRE for Diffusion-Generated Image Detectioncited by 386
14 more
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 318
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 278
- 2019Fourier Spectrum Discrepancies in Deep Network Generated Imagescited by 138
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 123
- 2024Zero-Shot Detection of AI-Generated Imagescited by 50
- 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learningcited by 48
- 2023Pixel-Inconsistency Modeling for Image Manipulation Localizationcited by 33
- 2024MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detectioncited by 27
- 2025LLM Unlearning with LLM Beliefscited by 17
- 2023Rethinking Image Forgery Detection via Soft Contrastive Learning and Unsupervised Clusteringcited by 12
- 2024DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domaincited by 12
- 2023Regroup Median Loss for Combating Label Noisecited by 8
- 2025FontGuard: A Robust Font Watermarking Approach Leveraging Deep Font Knowledgecited by 3
- 2026AEGIS: Adversarial Target-Guided Retention-Data-Free Robust Concept Erasure from Diffusion Modelscited by 3
Built on by
Not cited yet.