Can We Build a Monolithic Model for Fake Image Detection? SICA: Semantic-Induced Constrained Adaptation for Unified-Yet-Discriminative Artifact Feature Space Reconstruction
Not on the map. Why?
Abstract (arXiv)
Fake Image Detection (FID), aiming at unified detection across four image forensic subdomains, is critical in real-world forensic scenarios. Compared with ensemble approaches, monolithic FID models are theoretically more promising, but to date, consistently yield inferior performance in practice. In this work, we identify the intrinsic distinctness of artifacts across subdomains, a critical barrier we term the ``Ji-Zhe phenomenon". Driven by this phenomenon, we diagnose the cause of this underperformance for the first time: the collapse of the artifact feature space. The core challenge for developing a practical monolithic FID model thus boils down to the ``unified-yet-discriminative" reconstruction of the artifact feature space. To address this paradoxical challenge, we hypothesize that high-level semantics can serve as a structural prior for the reconstruction, and further propose Semantic-Induced Constrained Adaptation (SICA), the first monolithic FID paradigm. Extensive experiments on our OpenMMSec dataset demonstrate that SICA outperforms 15 state-of-the-art methods and reconstructs the target unified-yet-discriminative artifact feature space in a near-orthogonal manner, thus firmly validating our hypothesis. The code and dataset are available at: https://github.com/venus-guangjian/SICA_OpenMMSec.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 56 of its 78 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
56 of 78 references.
References · 56
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
38 more
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022A ConvNet for the 2020scited by 3,579
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
- 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 166
- 2018Learning Rich Features for Image Manipulation Detectioncited by 154
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
- 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
- 2024A Bias-Free Training Paradigm for More General AI-generated Image Detectioncited by 67
- 2020Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlightscited by 59
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
- 2025CO-SPY: Combining Semantic and Pixel Features to Detect Synthetic Images by AIcited by 42
- 2024Mesoscopic Insights: Orchestrating Multi-scale & Hybrid Architecture for Image Manipulation Localizationcited by 35
- 2023Pre-training-free Image Manipulation Localization through Non-Mutually Exclusive Contrastive Learningcited by 23
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.