Learning Universal Features for Generalizable Image Forgery Localization
Not on the map. Why?
Abstract (arXiv)
In recent years, advanced image editing and generation methods have rapidly evolved, making detecting and locating forged image content increasingly challenging. Most existing image forgery detection methods rely on identifying the edited traces left in the image. However, because the traces of different forgeries are distinct, these methods can identify familiar forgeries included in the training data but struggle to handle unseen ones. In response, we present an approach for Generalizable Image Forgery Localization (GIFL). Once trained, our model can detect both seen and unseen forgeries, providing a more practical and efficient solution to counter false information in the era of generative AI. Our method focuses on learning general features from the pristine content rather than traces of specific forgeries, which are relatively consistent across different types of forgeries and therefore can be used as universal features to locate unseen forgeries. Additionally, as existing image forgery datasets are still dominated by traditional hand-crafted forgeries, we construct a new dataset consisting of images edited by various popular deep generative image editing methods to further encourage research in detecting images manipulated by deep generative models. Extensive experimental results show that the proposed approach outperforms state-of-the-art methods in the detection of unseen forgeries and also demonstrates competitive results for seen forgeries. The code and dataset are available at https://github.com/ZhaoHengrun/GIFL.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 44 of its 81 references that are in the map. First posted on arXiv 10 Apr 2025.
Builds on
44 of 81 references.
References · 44
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
32 more
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 583
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2022Context Autoencoder for Self-Supervised Representation Learningcited by 297
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
- 2018Training behavior of deep neural network in frequency domaincited by 174
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2019IoU Loss for 2D/3D Object Detectioncited by 128
- 2019Detecting GAN generated Fake Images using Co-occurrence Matricescited by 124
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
- 2018Detecting GAN-generated Imagery using Color Cuescited by 76
- 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 44
- 2022SceneComposer: Any-Level Semantic Image Synthesiscited by 43
- 2021SketchEdit: Mask-Free Local Image Manipulation with Partial Sketchescited by 33
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
- 2023Rethinking Image Editing Detection in the Era of Generative AI Revolutioncited by 21
- 2023Effective Image Tampering Localization via Enhanced Transformer and Co-attention Fusioncited by 15
- 2023Rethinking Image Forgery Detection via Soft Contrastive Learning and Unsupervised Clusteringcited by 12
- 2017A PatchMatch-based Dense-field Algorithm for Video Copy-Move Detection and Localizationcited by 9
- 2020Deep Convolutional Neural Network for Identifying Seam-Carving Forgerycited by 9
- 2023COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detectioncited by 5
- 2017Statistics of Deep Generated Imagescited by 4
- 2023On the Effectiveness of Image Manipulation Detection in the Age of Social Mediacited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.