mlsanityData to 14 Oct 2026

Hierarchical Fine-Grained Image Forgery Detection and Localization

arXiv 2303.17111 ↗First posted 30 Mar 2023cs.CVcited by 134

Not on the map. Why?

Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Differences in forgery attributes of images generated in CNN-synthesized and image-editing domains are large, and such differences make a unified image forgery detection and localization (IFDL) challenging. To this end, we present a hierarchical fine-grained formulation for IFDL representation learning. Specifically, we first represent forgery attributes of a manipulated image with multiple labels at different levels. Then we perform fine-grained classification at these levels using the hierarchical dependency between them. As a result, the algorithm is encouraged to learn both comprehensive features and inherent hierarchical nature of different forgery attributes, thereby improving the IFDL representation. Our proposed IFDL framework contains three components: multi-branch feature extractor, localization and classification modules. Each branch of the feature extractor learns to classify forgery attributes at one level, while localization and classification modules segment the pixel-level forgery region and detect image-level forgery, respectively. Lastly, we construct a hierarchical fine-grained dataset to facilitate our study. We demonstrate the effectiveness of our method on 7 different benchmarks, for both tasks of IFDL and forgery attribute classification. Our source code and dataset can be found: hrefhttps://github.com/CHELSEA234/HiFiIFDLgithub.com/CHELSEA234/HiFi-IFDL.

Key facts. Cited by 134 papers in the map (data through 14 Oct 2026). Builds on 59 of its 83 references that are in the map. First posted on arXiv 30 Mar 2023.

Builds on

59 of 83 references.

References · 59

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  10. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  11. 2017Non-local Neural Networkscited by 2,293
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
38 more
  1. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  2. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  3. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
  4. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  5. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
  6. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  7. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  8. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
  9. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  10. 2018Self-Attention Generative Adversarial Networkscited by 809
  11. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
  12. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  13. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  14. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  15. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  16. 2022On the detection of synthetic images generated by diffusion modelscited by 283
  17. 2020What makes fake images detectable? Understanding properties that generalizecited by 273
  18. 2019On the Detection of Digital Face Manipulationcited by 260
  19. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
  20. 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
  21. 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
  22. 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
  23. 2018Do GANs leave artificial fingerprints?cited by 190
  24. 2020Learning Self-Consistency for Deepfake Detectioncited by 179
  25. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  26. 2018Learning Rich Features for Image Manipulation Detectioncited by 154
  27. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  28. 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 120
  29. 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
  30. 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
  31. 2022Towards the Detection of Diffusion Model Deepfakescited by 111
  32. 2018ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detectioncited by 104
  33. 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
  34. 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
  35. 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
  36. 2021Image-to-image Translation via Hierarchical Style Disentanglementcited by 63
  37. 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
  38. 2020FakeLocator: Robust Localization of GAN-Based Face Manipulationscited by 40

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 18; 2024: 41; 2025: 44; 2026: 31.

134 papers.

Sort:

By area:

  1. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
  2. 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 111
  3. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
  4. 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
  5. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
  6. 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
  7. 2024Common Sense Reasoning for Deepfake Detectioncited by 65
  8. 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
  9. 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
  10. 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learningcited by 49
  11. 2023Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionalitycited by 44
  12. 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 44
38 more
  1. 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
  2. 2024Diffusion Facial Forgery Detectioncited by 41
  3. 2024On Learning Multi-Modal Forgery Representation for Diffusion Generated Video Detectioncited by 40
  4. 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 40
  5. 2023Unlearnable Examples for Diffusion Models: Protect Data from Unauthorized Exploitationcited by 37
  6. 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarkingcited by 35
  7. 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibrationcited by 34
  8. 2025VideoShield: Regulating Diffusion-based Video Generation Models via Watermarkingcited by 34
  9. 2024WildFake: A Large-scale Challenging Dataset for AI-Generated Images Detectioncited by 31
  10. 2023Weakly-supervised deepfake localization in diffusion-generated imagescited by 24
  11. 2023ChatGPT-Powered Hierarchical Comparisons for Image Classificationcited by 22
  12. 2025ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localizationcited by 22
  13. 2023Detect Any Deepfakes: Segment Anything Meets Face Forgery Detection and Localizationcited by 20
  14. 2024Bi-LORA: A Vision-Language Approach for Synthetic Image Detectioncited by 20
  15. 2025Toward Generalizable Forgery Detection and Reasoningcited by 20
  16. 2024GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localizationcited by 19
  17. 2024DeCLIP: Decoding CLIP representations for deepfake localizationcited by 17
  18. 2025Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMscited by 17
  19. 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localizationcited by 16
  20. 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localizationcited by 15
  21. 2024DiffStega: Towards Universal Training-Free Coverless Image Steganography with Diffusion Modelscited by 15
  22. 202550 Years of Automated Face Recognitioncited by 15
  23. 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
  24. 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 13
  25. 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localizationcited by 13
  26. 2025Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Modelscited by 13
  27. 2024Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Tracescited by 12
  28. 2024GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learningcited by 12
  29. 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Modelscited by 12
  30. 2025The Change You Want To Detect: Semantic Change Detection In Earth Observation With Hybrid Data Generationcited by 12
  31. 2023Multi-spectral Class Center Network for Face Manipulation Detection and Localizationcited by 11
  32. 2025TalkingHeadBench: A Multi-Modal Benchmark & Analysis of Talking-Head DeepFake Detectioncited by 11
  33. 2025UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localizationcited by 9
  34. 2023Tracing Hyperparameter Dependencies for Model Parsing via Learnable Graph Pooling Networkcited by 8
  35. 2024Diffusion Deepfakecited by 8
  36. 2024Evolution of Detection Performance throughout the Online Lifespan of Synthetic Imagescited by 8
  37. 2024FaceShield: Defending Facial Image against Deepfake Threatscited by 8
  38. 2026Venus-DeFakerOne: Unified Fake Image Detection & Localizationcited by 8

50 most cited of 134 All 134 (JSON)