mlsanityData to 14 Oct 2026

TruFor: Leveraging all-round clues for trustworthy image forgery detection and localization

arXiv 2212.10957 ↗First posted 21 Dec 2022cs.CVcited by 130

Not on the map. Why?

Abstract (arXiv)

In this paper we present TruFor, a forensic framework that can be applied to a large variety of image manipulation methods, from classic cheapfakes to more recent manipulations based on deep learning. We rely on the extraction of both high-level and low-level traces through a transformer-based fusion architecture that combines the RGB image and a learned noise-sensitive fingerprint. The latter learns to embed the artifacts related to the camera internal and external processing by training only on real data in a self-supervised manner. Forgeries are detected as deviations from the expected regular pattern that characterizes each pristine image. Looking for anomalies makes the approach able to robustly detect a variety of local manipulations, ensuring generalization. In addition to a pixel-level localization map and a whole-image integrity score, our approach outputs a reliability map that highlights areas where localization predictions may be error-prone. This is particularly important in forensic applications in order to reduce false alarms and allow for a large scale analysis. Extensive experiments on several datasets show that our method is able to reliably detect and localize both cheapfakes and deepfakes manipulations outperforming state-of-the-art works. Code is publicly available at https://grip-unina.github.io/TruFor/

Key facts. Cited by 130 papers in the map (data through 14 Oct 2026). Builds on 27 of its 58 references that are in the map. First posted on arXiv 21 Dec 2022.

Builds on

27 of 58 references.

References · 27

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  3. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  4. 2020Supervised Contrastive Learningcited by 2,829
  5. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  7. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  8. 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
  9. 2022Blended Latent Diffusioncited by 432
  10. 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 231
  11. 2020Media Forensics and DeepFakes: an overviewcited by 209
  12. 2019Addressing Failure Prediction by Learning Model Confidencecited by 186
15 more
  1. 2018Learning Rich Features for Image Manipulation Detectioncited by 154
  2. 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
  3. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  4. 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
  5. 2018Noiseprint: a CNN-based camera model fingerprintcited by 114
  6. 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
  7. 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
  8. 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
  9. 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
  10. 2017Image Splicing Localization Using A Multi-Task Fully Convolutional Network (MFCN)cited by 64
  11. 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
  12. 2019Constrained R-CNN: A general image manipulation detection modelcited by 29
  13. 2019A Full-Image Full-Resolution End-to-End-Trainable CNN Framework for Image Forgery Detectioncited by 15
  14. 2020Toward Reliable Models for Authenticating Multimedia Content: Detecting Resampling Artifacts With Bayesian Neural Networkscited by 4
  15. 2022Comprehensive Dataset of Face Manipulations for Development and Evaluation of Forensic Toolscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 13; 2024: 32; 2025: 39; 2026: 46.

130 papers.

Sort:

By area:

  1. 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 111
  2. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
  3. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
  4. 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
  5. 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
  6. 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 44
  7. 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 43
  8. 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
  9. 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarkingcited by 35
  10. 2023Pixel-Inconsistency Modeling for Image Manipulation Localizationcited by 33
  11. 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
  12. 2023Weakly-supervised deepfake localization in diffusion-generated imagescited by 24
38 more
  1. 2025ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localizationcited by 22
  2. 2024TGIF: Text-Guided Inpainting Forgery Datasetcited by 20
  3. 2025Toward Generalizable Forgery Detection and Reasoningcited by 20
  4. 2024GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localizationcited by 19
  5. 2024DeCLIP: Decoding CLIP representations for deepfake localizationcited by 17
  6. 2025Zooming In on Fakes: A Novel Dataset for Localized AI-Generated Image Detection with Forgery Amplification Approachcited by 17
  7. 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localizationcited by 15
  8. 2023GenConViT: Deepfake Video Detection Using Generative Convolutional Vision Transformercited by 13
  9. 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 13
  10. 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localizationcited by 13
  11. 2023Rethinking Image Forgery Detection via Soft Contrastive Learning and Unsupervised Clusteringcited by 12
  12. 2023M3Dsynth: A dataset of medical 3D images with AI-generated local manipulationscited by 11
  13. 2024ForgerySleuth: Empowering Multimodal Large Language Models for Image Manipulation Detectioncited by 11
  14. 2025SAGI: Semantically Aligned and Uncertainty Guided AI Image Inpaintingcited by 10
  15. 2024Evolution of Detection Performance throughout the Online Lifespan of Synthetic Imagescited by 8
  16. 2024ForgeryTTT: Zero-Shot Image Manipulation Localization with Test-Time Trainingcited by 8
  17. 2025Common Inpainted Objects In-N-Out of Contextcited by 8
  18. 2026Venus-DeFakerOne: Unified Fake Image Detection & Localizationcited by 8
  19. 2024Fusion Transformer with Object Mask Guidance for Image Forgery Analysiscited by 7
  20. 2024Mixture-of-Noises Enhanced Forgery-Aware Predictor for Multi-Face Manipulation Detection and Localizationcited by 7
  21. 2023Diffusion models meet image counter-forensicscited by 6
  22. 2025FantasyID: A dataset for detecting digital manipulations of ID-documentscited by 6
  23. 2025ForensicsSAM: Toward Robust and Unified Image Forgery Detection and Localization Resisting to Adversarial Attackcited by 6
  24. 2023MMFusion: Combining Image Forensic Filters for Visual Manipulation Detection and Localizationcited by 5
  25. 2024Is JPEG AI going to change image forensics?cited by 5
  26. 2025My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swappingcited by 5
  27. 2025So-Fake: Benchmarking and Explaining Social Media Image Forgery Detectioncited by 5
  28. 2025StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Modelscited by 5
  29. 2026AIForge-Doc: A Benchmark for Detecting AI-Forged Tampering in Financial and Form Documentscited by 5
  30. 2023Progressive Feedback-Enhanced Transformer for Image Forgery Localizationcited by 4
  31. 2024DA-HFNet: Progressive Fine-Grained Forgery Image Detection and Localization Based on Dual Attentioncited by 4
  32. 2025Towards Reliable Identification of Diffusion-based Image Manipulationscited by 4
  33. 2026DOCFORGE-BENCH: A Comprehensive 0-shot Benchmark for Document Forgery Detection and Analysiscited by 4
  34. 2026GPT4o-Receipt: A Dataset and Human Study for AI-Generated Document Forensicscited by 4
  35. 2024Dense Feature Interaction Network for Image Inpainting Localizationcited by 3
  36. 2024Synthetic Photography Detection: A Visual Guidance for Identifying Synthetic Images Created by AIcited by 3
  37. 2025Beyond Fully Supervised Pixel Annotations: Scribble-Driven Weakly-Supervised Framework for Image Manipulation Localizationcited by 3
  38. 2025Webly-Supervised Image Manipulation Localization via Category-Aware Auto-Annotationcited by 3

50 most cited of 130 All 130 (JSON)