VIGIL: Part-Grounded Structured Reasoning for Generalizable Deepfake Detection
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal large language models (MLLMs) offer a promising path toward interpretable deepfake detection by generating textual explanations. However, the reasoning process of current MLLM-based methods combines evidence generation and manipulation localization into a unified step. This combination blurs the boundary between faithful observations and hallucinated explanations, leading to unreliable conclusions. Building on this, we present VIGIL, a part-centric structured forensic framework inspired by expert forensic practice through a plan-then-examine pipeline: the model first plans which facial parts warrant inspection based on global visual cues, then examines each part with independently sourced forensic evidence. A stage-gated injection mechanism delivers part-level forensic evidence only during examination, ensuring that part selection remains driven by the model's own perception rather than biased by external signals. We further propose a progressive three-stage training paradigm whose reinforcement learning stage employs part-aware rewards to enforce anatomical validity and evidence--conclusion coherence. To enable rigorous generalizability evaluation, we construct OmniFake, a hierarchical 5-Level benchmark where the model, trained on only three foundational generators, is progressively tested up to in-the-wild social-media data. Extensive experiments on OmniFake and cross-dataset evaluations demonstrate that VIGIL consistently outperforms both expert detectors and concurrent MLLM-based methods across all generalizability levels.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 63 of its 72 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
63 of 72 references.
Closest ancestors · 2
Same direction, newest first
- 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoning28 Aug
- 2025FORGE: Forensic Reasoning with Grounded Evidence20 Mar
Other references · 61
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Visual Instruction Tuningcited by 7,869
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2025Qwen3-VL Technical Reportcited by 2,793
38 more
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2025DINOv3cited by 1,414
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2022Detecting Deepfakes with Self-Blended Imagescited by 338
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 231
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2021General Facial Representation Learning in a Visual-Linguistic Mannercited by 195
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2024Autoregressive Video Generation without Vector Quantizationcited by 186
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspectivecited by 89
- 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
- 2025Harmonizing Visual Representations for Unified Multimodal Understanding and Generationcited by 74
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 69
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2024Common Sense Reasoning for Deepfake Detectioncited by 65
- 2025Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Modelscited by 64
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
- 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 60
- 2024Real-Time Deepfake Detection in the Real-Worldcited by 51
- 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
- 2025CO-SPY: Combining Semantic and Pixel Features to Detect Synthetic Images by AIcited by 42
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Veritas++: Value-aware On-Policy Distillation for Perception-Enhanced AIGI Detectioncited by 2
- 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoningcited by 0
- 2026MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Taskscited by 0
- 2026MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Tasks27 Sep 2026
- 2026Veritas++: Value-aware On-Policy Distillation for Perception-Enhanced AIGI Detection29 Jul 2026
- 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning19 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection
- 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
- 2026Pixels Don't Lie (But Your Detector Might): Bootstrapping MLLM-as-a-Judge for Trustworthy Deepfake Detection and Reasoning Supervision
- 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection
- 2025LLMs Are Not Yet Ready for Deepfake Image Detection
- 2025Training-Free Multimodal Deepfake Detection via Graph Reasoning
- 2026MSU Team at the Explainable Deepfake Detection Challenge 2026: Grounded Artifact Evidence for Deepfake Detection
- 2025PRPO: Paragraph-level Policy Optimization for Vision-Language Deepfake Detection