From Detection to Localization: A Unified Forensics Framework for Fully Synthetic and Tampered Images
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of generative models has significantly worsened the problem of manipulated image detection, as these methods are capable of producing highly realistic forgeries, reinforcing the importance of multimedia forensics. Conventional approaches typically frame image manipulation detection as a binary classification task (real vs. generated), which limits the capability to distinguish and localize different forms of manipulation. To address these constraints, this work extends an existing detector by introducing a unified multiclass framework (real vs. fully generated vs. tampered). In addition to classifying image authenticity, the framework incorporates a segmentation branch to enable pixel-level localization of tampered regions. The proposed approach outperforms selected recent benchmarks, offering an efficient solution with improved classification accuracy and higher IoU scores for the localization task. Find the code at https://github.com/anngal01/From-Detection-to-Localization-A-Unified-Forensics-Framework-for-Fully-Synthetic-and-Tampered-Images.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 48 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
36 of 48 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023Visual Instruction Tuningcited by 7,869
- 2022Generative Adversarial Networkscited by 5,627
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2018Group Normalizationcited by 1,524
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
24 more
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2023StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesiscited by 212
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
- 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
- 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
- 2019Learn to Segment Retinal Lesions and Beyondcited by 33
- 2025DeCLIP: Decoupled Learning for Open-Vocabulary Dense Perceptioncited by 33
- 2024Frequency Masking for Universal Deepfake Detectioncited by 23
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localizationcited by 16
- 2022How to Boost Face Recognition with StyleGAN?cited by 10
Built on by
Not cited yet.