mlsanityData to 14 Oct 2026

VIGIL: Part-Grounded Structured Reasoning for Generalizable Deepfake Detection

arXiv 2603.21526 ↗First posted 23 Mar 2026cs.CVcited by 3

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models (MLLMs) offer a promising path toward interpretable deepfake detection by generating textual explanations. However, the reasoning process of current MLLM-based methods combines evidence generation and manipulation localization into a unified step. This combination blurs the boundary between faithful observations and hallucinated explanations, leading to unreliable conclusions. Building on this, we present VIGIL, a part-centric structured forensic framework inspired by expert forensic practice through a plan-then-examine pipeline: the model first plans which facial parts warrant inspection based on global visual cues, then examines each part with independently sourced forensic evidence. A stage-gated injection mechanism delivers part-level forensic evidence only during examination, ensuring that part selection remains driven by the model's own perception rather than biased by external signals. We further propose a progressive three-stage training paradigm whose reinforcement learning stage employs part-aware rewards to enforce anatomical validity and evidence--conclusion coherence. To enable rigorous generalizability evaluation, we construct OmniFake, a hierarchical 5-Level benchmark where the model, trained on only three foundational generators, is progressively tested up to in-the-wild social-media data. Extensive experiments on OmniFake and cross-dataset evaluations demonstrate that VIGIL consistently outperforms both expert detectors and concurrent MLLM-based methods across all generalizability levels.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 63 of its 72 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

63 of 72 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoning28 Aug
  2. 2025FORGE: Forensic Reasoning with Grounded Evidence20 Mar

Other references · 61

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  6. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  9. 2014Deep Learning Face Attributes in the Wildcited by 3,693
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  11. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  12. 2025Qwen3-VL Technical Reportcited by 2,793
38 more
  1. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  2. 2025DINOv3cited by 1,414
  3. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  4. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  5. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  6. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  7. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  8. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  9. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  10. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
  11. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  12. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  13. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
  14. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
  15. 2022Detecting Deepfakes with Self-Blended Imagescited by 338
  16. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
  17. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  18. 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 231
  19. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
  20. 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
  21. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  22. 2024Autoregressive Video Generation without Vector Quantizationcited by 186
  23. 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
  24. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
  25. 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
  26. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
  27. 2024Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspectivecited by 89
  28. 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
  29. 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
  30. 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 69
  31. 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
  32. 2024Common Sense Reasoning for Deepfake Detectioncited by 65
  33. 2025Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Modelscited by 64
  34. 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
  35. 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 60
  36. 2024Real-Time Deepfake Detection in the Real-Worldcited by 51
  37. 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
  38. 2025CO-SPY: Combining Semantic and Pixel Features to Detect Synthetic Images by AIcited by 42

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection
  2. 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
  3. 2026Pixels Don't Lie (But Your Detector Might): Bootstrapping MLLM-as-a-Judge for Trustworthy Deepfake Detection and Reasoning Supervision
  4. 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection
  5. 2025LLMs Are Not Yet Ready for Deepfake Image Detection
  6. 2025Training-Free Multimodal Deepfake Detection via Graph Reasoning
  7. 2026MSU Team at the Explainable Deepfake Detection Challenge 2026: Grounded Artifact Evidence for Deepfake Detection
  8. 2025PRPO: Paragraph-level Policy Optimization for Vision-Language Deepfake Detection