Bi-Level Optimization for Self-Supervised AI-Generated Face Detection
Not on the map. Why?
Abstract (arXiv)
AI-generated face detectors trained via supervised learning typically rely on synthesized images from specific generators, limiting their generalization to emerging generative techniques. To overcome this limitation, we introduce a self-supervised method based on bi-level optimization. In the inner loop, we pretrain a vision encoder only on photographic face images using a set of linearly weighted pretext tasks: classification of categorical exchangeable image file format (EXIF) tags, ranking of ordinal EXIF tags, and detection of artificial face manipulations. The outer loop then optimizes the relative weights of these pretext tasks to enhance the coarse-grained detection of manipulated faces, serving as a proxy task for identifying AI-generated faces. In doing so, it aligns self-supervised learning more closely with the ultimate goal of AI-generated face detection. Once pretrained, the encoder remains fixed, and AI-generated faces are detected either as anomalies under a Gaussian mixture model fitted to photographic face features or by a lightweight two-layer perceptron serving as a binary classifier. Extensive experiments demonstrate that our detectors significantly outperform existing approaches in both one-class and binary classification settings, exhibiting strong generalization to unseen generators.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 45 of its 70 references that are in the map. First posted on arXiv 30 Jul 2025.
Builds on
45 of 70 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2018DARTS: Differentiable Architecture Searchcited by 1,798
33 more
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2022VOS: Learning What You Don't Know by Virtual Outlier Synthesiscited by 300
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 297
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2019Scaling and Benchmarking Self-Supervised Visual Representation Learningcited by 201
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 123
- 2019DeepPrivacy: A Generative Adversarial Network for Face Anonymizationcited by 108
- 2021Instance Localization for Self-supervised Detection Pretrainingcited by 99
- 2022Self-Supervised Learning of Object Parts for Semantic Segmentationcited by 90
- 2021Self-Supervised Pretraining Improves Self-Supervised Pretrainingcited by 82
- 2022Auto-Lambda: Disentangling Dynamic Task Relationshipscited by 73
- 2020Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlightscited by 59
- 2024Zero-Shot Detection of AI-Generated Imagescited by 50
- 2021Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Facescited by 48
- 2022NoisyTune: A Little Noise Can Help You Finetune Pretrained Language Models Bettercited by 43
- 2024Diffusion Facial Forgery Detectioncited by 41
- 2022Structure-aware Protein Self-supervised Learningcited by 33
- 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 30
- 2023EXIF as Language: Learning Cross-Modal Associations Between Images and Camera Metadatacited by 17
- 2023AlignDet: Aligning Pre-training and Fine-tuning in Object Detectioncited by 14
- 2024Semantic Contextualization of Face Forgery: A New Definition, Dataset, and Detection Methodcited by 8
- 2024Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approachcited by 4
- 2025Self-Supervised Learning for Detecting AI-Generated Faces as Anomaliescited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025DGS-Net: Distillation-Guided Gradient Surgery for CLIP Fine-Tuning in AI-Generated Image Detectioncited by 5
- 2025Edge-Enhanced Vision Transformer Framework for Accurate AI-Generated Image Detectioncited by 1
- 2026ActivityForensics: A Comprehensive Benchmark for Localizing Manipulated Activity in Videoscited by 1
- 2026Color Matters: Demosaicing-Guided Color Correlation Training for Generalizable AI-Generated Image Detectioncited by 0
- 2026ActivityForensics: A Comprehensive Benchmark for Localizing Manipulated Activity in Videos4 Apr 2026
- 2026Color Matters: Demosaicing-Guided Color Correlation Training for Generalizable AI-Generated Image Detection30 Jan 2026
- 2025DGS-Net: Distillation-Guided Gradient Surgery for CLIP Fine-Tuning in AI-Generated Image Detection17 Nov 2025
- 2025Edge-Enhanced Vision Transformer Framework for Accurate AI-Generated Image Detection25 Aug 2025