mlsanityData to 14 Oct 2026

PATE-Forensics: Perception-as-Tool for Explainable Deepfake Forensics with General-Purpose MLLMs

arXiv 2608.18573 ↗First posted 19 Aug 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Existing explainable deepfake forensic methods typically rely on task-adapted MLLM to jointly address detection, localization, and explanation. Inspired by agent-style tool use, we instead introduce a Perception-as-Tool paradigm and instantiate it as PATE-Forensics, which architecturally decouples detection and localization from explanation generation while coupling detection and localization as tightly as possible within a forensic perception tool. The DINOv3-based tool couples a multi-granularity detection module that integrates global, patch-level, and segment-level evidence with a cue-guided localization module by spatializing the patch-level and segment-level evidence into forgery score maps that guide dense mask prediction. The original image and forensic perception outputs produced by the tool form structured forensic context for a general-purpose MLLM, which is guided by prompt constraints to generate explanations without task-specific fine-tuning. On DDL-X Track 3, PATE-Forensics achieves the best official score of 0.89, outperforming the second-ranked team by 0.19 points. Our code is available at https://github.com/yqli00000/PATE-Forensics.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 25 references that are in the map. First posted on arXiv 19 Aug 2026.

Builds on

23 of 25 references.

References · 23

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  5. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  6. 2021Multi-attentional Deepfake Detectioncited by 341
  7. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
  8. 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
  9. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
  10. 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
  11. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
  12. 2019Deep Learning for Deepfakes Creation and Detection: A Surveycited by 102
11 more
  1. 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
  2. 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 38
  3. 2025OpenSDI: Spotting Diffusion-Generated Images in the Open Worldcited by 23
  4. 2025Zooming In on Fakes: A Novel Dataset for Localized AI-Generated Image Detection with Forgery Amplification Approachcited by 17
  5. 2021Finding Facial Forgery Artifacts with Parts-Based Detectorscited by 14
  6. 2026INSID3: Training-Free In-Context Segmentation with DINOv3cited by 12
  7. 2026Robust Deepfake Detection, NTIRE 2026 Challenge: Reportcited by 6
  8. 2024Linguistic Profiling of Deepfakes: An Open Database for Next-Generation Deepfake Detectioncited by 5
  9. 2025DDL: A Large-Scale Dataset for Deepfake Detection and Localization in Diversified Real-World Scenarioscited by 4
  10. 2026Omni-Fake: Benchmarking Unified Multimodal Social Media Deepfake Detectioncited by 3
  11. 2026Leave No Stone Unturned: Uncovering Holistic Audio-Visual Intrinsic Coherence for Deepfake Detectioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
  2. 2026MSU Team at the Explainable Deepfake Detection Challenge 2026: Grounded Artifact Evidence for Deepfake Detection
  3. 2026Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detection
  4. 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection
  5. 2025INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative Artifacts
  6. 2025FORGE: Forensic Reasoning with Grounded Evidence
  7. 2026Deepfake Forensics Adapter: A Dual-Stream Network for Generalizable Deepfake Detection
  8. 2026VIGIL: Part-Grounded Structured Reasoning for Generalizable Deepfake Detection