Discrepancy-Guided Reconstruction Learning for Image Forgery Detection
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel image forgery detection paradigm for boosting the model learning capacity on both forgery-sensitive and genuine compact visual patterns. Compared to the existing methods that only focus on the discrepant-specific patterns (eg, noises, textures, and frequencies), our method has a greater generalization. Specifically, we first propose a Discrepancy-Guided Encoder (DisGE) to extract forgery-sensitive visual patterns. DisGE consists of two branches, where the mainstream backbone branch is used to extract general semantic features, and the accessorial discrepant external attention branch is used to extract explicit forgery cues. Besides, a Double-Head Reconstruction (DouHR) module is proposed to enhance genuine compact visual patterns in different granular spaces. Under DouHR, we further introduce a Discrepancy-Aggregation Detector (DisAD) to aggregate these genuine compact visual patterns, such that the forgery detection capability on unknown patterns can be improved. Extensive experimental results on four challenging datasets validate the effectiveness of our proposed method against state-of-the-art competitors.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 38 of its 59 references that are in the map. First posted on arXiv 26 Apr 2023.
Builds on
38 of 59 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
26 more
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
- 2018Classification-Reconstruction Learning for Open-Set Recognitioncited by 146
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
- 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
- 2021Representative Forgery Mining for Fake Face Detectioncited by 108
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
- 2020Feature Pyramid Transformercited by 96
- 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
- 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
- 2022Learning Second Order Local Anomaly for General Face Forgery Detectioncited by 36
- 2020Graph-FCN for image semantic segmentationcited by 13
- 2022Graph Reasoning Transformer for Image Parsingcited by 9
- 2018HybridNet: Classification and Reconstruction Cooperation for Semi-Supervised Learningcited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 3.
7 papers.
- 2023Diffusion Noise Feature: Accurate and Fast Generated Image Detectioncited by 21
- 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Tracescited by 12
- 2025FerretNet: Efficient Synthetic Image Detection via Local Pixel Dependenciescited by 12
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
- 2024Band-Attention Modulation Network for Robust Face Forgery Detectioncited by 1
- 2025Think Twice before Adaptation: Improving Adaptability of DeepFake Detection via Online Test-Time Adaptationcited by 1
- 2025RoGA: Towards Generalizable Deepfake Detection through Robust Gradient Alignmentcited by 1
- 2025FerretNet: Efficient Synthetic Image Detection via Local Pixel Dependencies25 Sep 2025
- 2025RoGA: Towards Generalizable Deepfake Detection through Robust Gradient Alignment27 May 2025
- 2025Think Twice before Adaptation: Improving Adaptability of DeepFake Detection via Online Test-Time Adaptation24 May 2025
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey26 Nov 2024
- 2024Band-Attention Modulation Network for Robust Face Forgery Detection9 Apr 2024
- 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Traces24 Jan 2024
- 2023Diffusion Noise Feature: Accurate and Fast Generated Image Detection5 Dec 2023