Recasting Residual-based Local Descriptors as Convolutional Neural Networks: an Application to Image Forgery Detection
Not on the map. Why?
Abstract (arXiv)
Local descriptors based on the image noise residual have proven extremely effective for a number of forensic applications, like forgery detection and localization. Nonetheless, motivated by promising results in computer vision, the focus of the research community is now shifting on deep learning. In this paper we show that a class of residual-based descriptors can be actually regarded as a simple constrained convolutional neural network (CNN). Then, by relaxing the constraints, and fine-tuning the net on a relatively small training set, we obtain a significant performance improvement with respect to the conventional detector.
Key facts. Cited by 56 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 15; 2023: 11; 2024: 1; 2025: 2; 2026: 2.
56 papers.
Sort:
By area:
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attackscited by 81
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 74
- 2021Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learningcited by 60
- 2022MARLIN: Masked Autoencoder for facial video Representation LearnINgcited by 57
38 more
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 43
- 2023Perceptual Artifacts Localization for Image Synthesis Taskscited by 43
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
- 2022Exploring Disentangled Content Information for Face Forgery Detectioncited by 36
- 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
- 2021Wavelet-Packets for Deepfake Image Analysis and Detectioncited by 25
- 2022GLFF: Global and Local Feature Fusion for AI-synthesized Image Detectioncited by 25
- 2021TAR: Generalized Forensic Framework to Detect Deepfakes using Weakly Supervised Learningcited by 19
- 2021FaceGuard: Proactive Deepfake Detectioncited by 16
- 2021Detection and Localization of Facial Expression Manipulationscited by 15
- 2021Deepfake Forensics via An Adversarial Gamecited by 15
- 2021Finding Facial Forgery Artifacts with Parts-Based Detectorscited by 14
- 2023Learning Pairwise Interaction for Generalizable DeepFake Detectioncited by 11
- 2021Metric Learning for Anti-Compression Facial Forgery Detectioncited by 9
- 2021Detection of Deepfake Videos Using Long Distance Attentioncited by 9
- 2022DeePhy: On Deepfake Phylogenycited by 8
- 2021A-PixelHop: A Green, Robust and Explainable Fake-Image Detectorcited by 7
- 2021Understanding the Security of Deepfake Detectioncited by 6
- 2022Multimodal Graph Learning for Deepfake Detectioncited by 6
- 2021TBNet:Two-Stream Boundary-aware Network for Generic Image Manipulation Localizationcited by 4
- 2021MD-CSDNetwork: Multi-Domain Cross Stitched Network for Deepfake Detectioncited by 4
- 2021Distinguishing Natural and Computer-Generated Images using Multi-Colorspace fused EfficientNetcited by 4
- 2023Undercover Deepfakes: Detecting Fake Segments in Videoscited by 4
- 2023Unmasking Deepfakes: Masked Autoencoding Spatiotemporal Transformers for Enhanced Video Forgery Detectioncited by 4
- 2022Attacking Image Splicing Detection and Localization Algorithms Using Synthetic Tracescited by 3
- 2023On quantifying and improving realism of images generated with diffusioncited by 3
- 2023GazeForensics: DeepFake Detection via Gaze-guided Spatial Inconsistency Learningcited by 3
- 2023Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectorscited by 3
- 2021Holistic Image Manipulation Detection using Pixel Co-occurrence Matricescited by 2
- 2021Automated Deepfake Detectioncited by 2
- 2025Image Watermarking of Generative Diffusion Modelscited by 2
- 2021Fake Visual Content Detection Using Two-Stream Convolutional Neural Networkscited by 1
- 2022Adaptive Frequency Learning in Two-branch Face Forgery Detectioncited by 1
- 2021MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detectioncited by 0
- 2021MissMarple : A Novel Socio-inspired Feature-transfer Learning Deep Network for Image Splicing Detectioncited by 0
- 2022Learning Robust Representations Of Generative Models Using Set-Based Artificial Fingerprintscited by 0
50 most cited of 56 All 56 (JSON)
- 2026JECA^2: Judgment-Explanation Consistent Adversarial Attack against Forensic Vision-Language Models27 May 2026
- 2026Curvelet-Based Frequency-Aware Feature Enhancement for Deepfake Detection13 Apr 2026
- 2025Dynamic watermarks in images generated by diffusion models13 Feb 2025
- 2025Image Watermarking of Generative Diffusion Models12 Feb 2025
- 2024Recompression Based JPEG Tamper Detection and Localization Using Deep Neural Network Eliminating Compression Factor Dependency3 Jul 2024
- 2023Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors17 Nov 2023
- 2023GazeForensics: DeepFake Detection via Gaze-guided Spatial Inconsistency Learning13 Nov 2023
- 2023Perceptual Artifacts Localization for Image Synthesis Tasks9 Oct 2023
- 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attacks29 Sep 2023
- 2023On quantifying and improving realism of images generated with diffusion26 Sep 2023
- 2023Unmasking Deepfakes: Masked Autoencoding Spatiotemporal Transformers for Enhanced Video Forgery Detection12 Jun 2023
- 2023Undercover Deepfakes: Detecting Fake Segments in Videos11 May 2023
38 more
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization3 May 2023
- 2023Learning Pairwise Interaction for Generalizable DeepFake Detection26 Feb 2023
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Models20 Feb 2023
- 2023Deepfake Detection using Biological Features: A Survey14 Jan 2023
- 2022Attacking Image Splicing Detection and Localization Algorithms Using Synthetic Traces22 Nov 2022
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakes21 Nov 2022
- 2022GLFF: Global and Local Feature Fusion for AI-synthesized Image Detection16 Nov 2022
- 2022MARLIN: Masked Autoencoder for facial video Representation LearnINg12 Nov 2022
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization26 Oct 2022
- 2022When Handcrafted Features and Deep Features Meet Mismatched Training and Test Sets for Deepfake Detection27 Sep 2022
- 2022DeePhy: On Deepfake Phylogeny19 Sep 2022
- 2022Multimodal Graph Learning for Deepfake Detection12 Sep 2022
- 2022Explaining Deepfake Detection by Analysing Image Matching20 Jul 2022
- 2022Exploring Disentangled Content Information for Face Forgery Detection19 Jul 2022
- 2022CORE: Consistent Representation Learning for Face Forgery Detection6 Jun 2022
- 2022Learning Robust Representations Of Generative Models Using Set-Based Artificial Fingerprints4 Jun 2022
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detection29 Mar 2022
- 2022Adaptive Frequency Learning in Two-branch Face Forgery Detection27 Mar 2022
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection18 Jan 2022
- 2021Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learning28 Dec 2021
- 2021MissMarple : A Novel Socio-inspired Feature-transfer Learning Deep Network for Image Splicing Detection15 Dec 2021
- 2021A-PixelHop: A Green, Robust and Explainable Fake-Image Detector7 Nov 2021
- 2021Distinguishing Natural and Computer-Generated Images using Multi-Colorspace fused EfficientNet18 Oct 2021
- 2021MC-LCR: Multi-modal contrastive classification by locally correlated representations for effective face forgery detection7 Oct 2021
- 2021Finding Facial Forgery Artifacts with Parts-Based Detectors21 Sep 2021
- 2021MD-CSDNetwork: Multi-Domain Cross Stitched Network for Deepfake Detection15 Sep 2021
- 2021FaceGuard: Proactive Deepfake Detection13 Sep 2021
- 2021TBNet:Two-Stream Boundary-aware Network for Generic Image Manipulation Localization10 Aug 2021
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltales13 Jul 2021
- 2021Understanding the Security of Deepfake Detection5 Jul 2021
- 2021Detection of Deepfake Videos Using Long Distance Attention24 Jun 2021
- 2021Automated Deepfake Detection20 Jun 2021
- 2021Wavelet-Packets for Deepfake Image Analysis and Detection17 Jun 2021
- 2021TAR: Generalized Forensic Framework to Detect Deepfakes using Weakly Supervised Learning13 May 2021
- 2021Local Relation Learning for Face Forgery Detection6 May 2021
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection20 Apr 2021
- 2021Holistic Image Manipulation Detection using Pixel Co-occurrence Matrices12 Apr 2021
- 2021Deepfake Forensics via An Adversarial Game25 Mar 2021
50 newest of 56 All 56 (JSON)
- 2022GLFF: Global and Local Feature Fusion for AI-synthesized Image Detectioncited by 25
- 2023Undercover Deepfakes: Detecting Fake Segments in Videoscited by 4
- 2023On quantifying and improving realism of images generated with diffusioncited by 3
- 2025Image Watermarking of Generative Diffusion Modelscited by 2
- 2025Dynamic watermarks in images generated by diffusion modelscited by 0
- 2025Dynamic watermarks in images generated by diffusion models13 Feb 2025
- 2025Image Watermarking of Generative Diffusion Models12 Feb 2025
- 2023On quantifying and improving realism of images generated with diffusion26 Sep 2023
- 2023Undercover Deepfakes: Detecting Fake Segments in Videos11 May 2023
- 2022GLFF: Global and Local Feature Fusion for AI-synthesized Image Detection16 Nov 2022
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2021Multi-attentional Deepfake Detectioncited by 341
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2022CORE: Consistent Representation Learning for Face Forgery Detectioncited by 74
- 2021Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learningcited by 60
- 2022MARLIN: Masked Autoencoder for facial video Representation LearnINgcited by 57
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakescited by 49
12 most cited of 49 All 49 (JSON)
- 2026Curvelet-Based Frequency-Aware Feature Enhancement for Deepfake Detection13 Apr 2026
- 2024Recompression Based JPEG Tamper Detection and Localization Using Deep Neural Network Eliminating Compression Factor Dependency3 Jul 2024
- 2023Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors17 Nov 2023
- 2023GazeForensics: DeepFake Detection via Gaze-guided Spatial Inconsistency Learning13 Nov 2023
- 2023Perceptual Artifacts Localization for Image Synthesis Tasks9 Oct 2023
- 2023Unmasking Deepfakes: Masked Autoencoding Spatiotemporal Transformers for Enhanced Video Forgery Detection12 Jun 2023
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization3 May 2023
- 2023Learning Pairwise Interaction for Generalizable DeepFake Detection26 Feb 2023
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Models20 Feb 2023
- 2023Deepfake Detection using Biological Features: A Survey14 Jan 2023
- 2022Attacking Image Splicing Detection and Localization Algorithms Using Synthetic Traces22 Nov 2022
- 2022SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakes21 Nov 2022
12 newest of 49 All 49 (JSON)