mlsanityData to 14 Oct 2026

Discrepancy-Guided Reconstruction Learning for Image Forgery Detection

arXiv 2304.13349 ↗First posted 26 Apr 2023cs.CV cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose a novel image forgery detection paradigm for boosting the model learning capacity on both forgery-sensitive and genuine compact visual patterns. Compared to the existing methods that only focus on the discrepant-specific patterns (eg, noises, textures, and frequencies), our method has a greater generalization. Specifically, we first propose a Discrepancy-Guided Encoder (DisGE) to extract forgery-sensitive visual patterns. DisGE consists of two branches, where the mainstream backbone branch is used to extract general semantic features, and the accessorial discrepant external attention branch is used to extract explicit forgery cues. Besides, a Double-Head Reconstruction (DouHR) module is proposed to enhance genuine compact visual patterns in different granular spaces. Under DouHR, we further introduce a Discrepancy-Aggregation Detector (DisAD) to aggregate these genuine compact visual patterns, such that the forgery detection capability on unknown patterns can be improved. Extensive experimental results on four challenging datasets validate the effectiveness of our proposed method against state-of-the-art competitors.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 38 of its 59 references that are in the map. First posted on arXiv 26 Apr 2023.

Builds on

38 of 59 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  5. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  6. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  7. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  8. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  9. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
  10. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  11. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
  12. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
26 more
  1. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  2. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  3. 2021Multi-attentional Deepfake Detectioncited by 341
  4. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
  5. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
  6. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
  7. 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
  8. 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 209
  9. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  10. 2021Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformerscited by 159
  11. 2018Classification-Reconstruction Learning for Open-Set Recognitioncited by 146
  12. 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
  13. 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
  14. 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
  15. 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
  16. 2021Representative Forgery Mining for Fake Face Detectioncited by 108
  17. 2021Local Relation Learning for Face Forgery Detectioncited by 100
  18. 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
  19. 2020Feature Pyramid Transformercited by 96
  20. 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
  21. 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
  22. 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
  23. 2022Learning Second Order Local Anomaly for General Face Forgery Detectioncited by 36
  24. 2020Graph-FCN for image semantic segmentationcited by 13
  25. 2022Graph Reasoning Transformer for Image Parsingcited by 9
  26. 2018HybridNet: Classification and Reconstruction Cooperation for Semi-Supervised Learningcited by 8

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 3; 2025: 3.

7 papers.