Detecting Localized Deepfakes: How Well Do Synthetic Image Detectors Handle Inpainting?
Not on the map. Why?
Abstract (arXiv)
The rapid progress of generative AI has enabled highly realistic image manipulations, including inpainting and region-level editing. These approaches preserve most of the original visual context and are increasingly exploited in cybersecurity-relevant threat scenarios. While numerous detectors have been proposed for identifying fully synthetic images, their ability to generalize to localized manipulations remains insufficiently characterized. This work presents a systematic evaluation of state-of-the-art detectors, originally trained for the deepfake detection on fully synthetic images, when applied to a distinct challenge: localized inpainting detection. The study leverages multiple datasets spanning diverse generators, mask sizes, and inpainting techniques. Our experiments show that models trained on a large set of generators exhibit partial transferability to inpainting-based edits and can reliably detect medium- and large-area manipulations or regeneration-style inpainting, outperforming many existing ad hoc detection approaches.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 46 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
25 of 46 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2022On the detection of synthetic images generated by diffusion modelscited by 283
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
13 more
- 2019EdgeConnect: Generative Image Inpainting with Adversarial Edge Learningcited by 163
- 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
- 2018Noiseprint: a CNN-based camera model fingerprintcited by 114
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
- 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
- 2018Shift-Net: Image Inpainting via Deep Feature Rearrangementcited by 87
- 2019Region Normalization for Image Inpaintingcited by 54
- 2024Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Learningcited by 20
- 2024TGIF: Text-Guided Inpainting Forgery Datasetcited by 20
- 2025Zooming In on Fakes: A Novel Dataset for Localized AI-Generated Image Detection with Forgery Amplification Approachcited by 17
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detectioncited by 10
- 2024Enhancing Conceptual Understanding in Multimodal Contrastive Learning through Hard Negative Samplescited by 6
- 2025Generalized Design Choices for Deepfake Detectorscited by 2
Built on by
Not cited yet.