mlsanityData to 7 Oct 2026

Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection

arXiv 2609.35536 ↗First posted 28 Sep 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness also fits: VLM benchmarks and visual reasoning

Abstract (arXiv)

Multimodal large language models (MLLMs) can explain deepfake verdicts in natural language, but such explanations are not necessarily visually grounded in the visual evidence underlying the prediction. A model may describe plausible artifacts inferred from language priors rather than from image evidence. Existing grounding methods improve visual reliance through decoding or attention interventions, but they generally strengthen grounding over the entire image, making them ill-suited for forensic artifacts that are subtle, spatially localized, and image-dependent. We propose Look Before You Judge, a training-free framework that formulates explainable deepfake detection as a sequential evidence acquisition process. Instead of directly predicting image authenticity from holistic visual reasoning, our framework first identifies image-specific candidate evidence regions by contrasting the MLLM's decoder-to-visual attention between an original image and its Gaussian-blurred counterpart. The identified regions are then inspected individually, and the resulting local evidence is integrated with the global image context before reaching a final verdict. The framework operates without manipulation masks, external forensic models, or parameter updates, making it directly applicable to off-the-shelf MLLMs. Across five open-source MLLMs on TriDF and MMTD-Set, our framework improves detection accuracy by up to 12.8%, reduces CHAIR by up to 33.4% and hallucination rate by up to 21.3%, and outperforms representative training-free decoding and attention methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 44 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

26 of 44 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Model5 Dec
  2. 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics21 Mar

Other references · 24

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  3. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  4. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 671
  5. 2018Object Hallucination in Image Captioningcited by 661
  6. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
  7. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  8. 2023OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocationcited by 468
  9. 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 180
  10. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  11. 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
  12. 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 122
12 more
  1. 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 88
  2. 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
  3. 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 43
  4. 2025Seeing Far and Clearly: Mitigating Hallucinations in MLLMs with Attention Causal Decodingcited by 42
  5. 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 37
  6. 2025Attention Reallocation: Towards Zero-cost and Controllable Hallucination Mitigation of MLLMscited by 23
  7. 2025VASparse: Towards Efficient Visual Hallucination Mitigation via Visual-Aware Token Sparsificationcited by 17
  8. 2025Head Pursuit: Probing Attention Specialization in Multimodal Transformerscited by 16
  9. 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLMcited by 12
  10. 2025Face-LLaVA: Facial Expression and Attribute Understanding through Instruction Tuningcited by 9
  11. 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detectioncited by 4
  12. 2025Reallocating Attention Across Layers to Reduce Multimodal Hallucinationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VIGIL: Part-Grounded Structured Reasoning for Generalizable Deepfake Detection
  2. 2025LLMs Are Not Yet Ready for Deepfake Image Detection
  3. 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
  4. 2025FORGE: Forensic Reasoning with Grounded Evidence
  5. 2026MSU Team at the Explainable Deepfake Detection Challenge 2026: Grounded Artifact Evidence for Deepfake Detection
  6. 2026Explainable Deepfake Detection with Feature-robust Augmentation and Evidence-grounded Explanation Optimization
  7. 2025TruthLens:A Training-Free Paradigm for DeepFake Detection
  8. 2025The Deepfake Detective: Interpreting Neural Forensics Through Sparse Features and Manifolds