mlsanityData to 14 Oct 2026

ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection

arXiv 2601.08873 ↗First posted 12 Jan 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The proliferation of AI-generated imagery and sophisticated editing tools has rendered traditional forensic methods ineffective for cross-domain forgery detection. We present ForensicFormer, a hierarchical multi-scale framework that unifies low-level artifact detection, mid-level boundary analysis, and high-level semantic reasoning via cross-attention transformers. Unlike prior single-paradigm approaches, which achieve <75% accuracy on out-of-distribution datasets, our method maintains 86.8% average accuracy across seven diverse test sets, spanning traditional manipulations, GAN-generated images, and diffusion model outputs - a significant improvement over state-of-the-art universal detectors. We demonstrate superior robustness to JPEG compression (83% accuracy at Q=70 vs. 66% for baselines) and provide pixel-level forgery localization with a 0.76 F1-score. Extensive ablation studies validate that each hierarchical component contributes 4-10% accuracy improvement, and qualitative analysis reveals interpretable forensic features aligned with human expert reasoning. Our work bridges classical image forensics and modern deep learning, offering a practical solution for real-world deployment where manipulation techniques are unknown a priori.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 54 references that are in the map. First posted on arXiv 12 Jan 2026.

Builds on

28 of 54 references.

References · 28

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  7. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  10. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  11. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  12. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
16 more
  1. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  2. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  3. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  4. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  5. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  6. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
  7. 2022On the detection of synthetic images generated by diffusion modelscited by 283
  8. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
  9. 2020Media Forensics and DeepFakes: an overviewcited by 209
  10. 2018Learning Rich Features for Image Manipulation Detectioncited by 154
  11. 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
  12. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  13. 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
  14. 2022Towards the Detection of Diffusion Model Deepfakescited by 111
  15. 2020Evading Deepfake-Image Detectors with White- and Black-Box Attackscited by 80
  16. 2020Detecting Cross-Modal Inconsistency to Defend Against Neural Fake Newscited by 42

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Toward Generalizable Forgery Detection and Reasoning
  2. 2026Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detection
  3. 2026Universal Anti-forensics Attack against Image Forgery Detection via Multi-modal Guidance
  4. 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization
  5. 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization
  6. 2025REVEAL -- Reasoning and Evaluation of Visual Evidence through Aligned Language
  7. 2026EditSleuth: A Dataset of Grounded Reasoning Chains for Image-Edit Forensics
  8. 2026FOCA: Frequency-Oriented Cross-Domain Forgery Detection, Localization and Explanation via Multi-Modal Large Language Model