Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detection
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Detecting AI-generated images with multimodal large language models (MLLMs) has gained increasing attention, due to their rich world knowledge, common-sense reasoning, and potential for explainability. However, naively applying those MLLMs for detection often leads to suboptimal performance. We argue that the root of this failure lies in a fundamental mismatch: MLLMs are asked to reason about fakes before they can truly see them. First, they do not really see: existing MLLMs' vision encoders are primarily optimized for semantic-oriented recognition rather than the perception of low-level signals, leaving them insensitive to subtle forgery traces. Without access to reliable perceptual evidence, the model grounds its judgment on incomplete and limited visual observations. Second, existing finetuning data for detection typically uses narrow, instruction-style formats, which diverge sharply from the diverse, heterogeneous distributions seen in pretraining. In the absence of meaningful visual cues, the model therefore exploits these linguistic shortcuts, resulting in catastrophic forgetting of pretrained knowledge (even the basic dialogue capabilities). In response, we advocate for a new paradigm: seeing before reasoning. We propose that MLLMs should first be trained to perceive artifacts-strengthening their artifact-aware visual perception-so that subsequent reasoning is grounded in actual observations. We therefore propose Forensic-Chat, a generalizable, explainable, and still-conversational (for multi-round dialogue) assistant for fake image detection. We also propose ExplainFake-Bench, a benchmark tailored for the evaluation of the MLLM's explainability for image forensics from five key aspects. Extensive experiments show its superiority of generalization and genuinely reliable explainability.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 65 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
26 of 65 references.
Closest ancestors · 1
Same direction, newest first
Other references · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
- 2024Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspectivecited by 89
- 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2025Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizablecited by 60
13 more
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58
- 2024Real-Time Deepfake Detection in the Real-Worldcited by 51
- 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?cited by 51
- 2024Learning or Self-aligning? Rethinking Instruction Fine-tuningcited by 43
- 2025On the generalization of language models from in-context learning and finetuning: a controlled studycited by 40
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detectioncited by 34
- 2025AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Modelscited by 33
- 2025Breaking Latent Prior Bias in Detectors for Generalizable AIGC Image Detectioncited by 16
- 2025MLLM-Enhanced Face Forgery Detection: A Vision-Language Fusion Solutioncited by 15
- 2025Unified Multimodal Models as Auto-Encoderscited by 13
- 2025VLForgery Face Triad: Detection, Localization and Attribution via Multimodal Large Language Modelscited by 12
- 2025Guard Me If You Know Me: Protecting Specific Face-Identity from Deepfakescited by 7
Built on by
Citing papers per year: 2025: 4; 2026: 16.
20 papers.
Sort:
By area:
- 2025RealGen: Photorealistic Text-to-Image Generation via Detector-Guided Rewardscited by 12
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localizationcited by 8
- 2025DINO-Detect: A Simple yet Effective Framework for Blur-Robust AI-Generated Image Detectioncited by 5
- 2025DGS-Net: Distillation-Guided Gradient Surgery for CLIP Fine-Tuning in AI-Generated Image Detectioncited by 5
- 2025AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignmentcited by 4
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detectioncited by 4
- 2026AgentFoX: LLM Agent-Guided Fusion with eXplainability for AI-Generated Image Detectioncited by 3
- 2026ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representationcited by 3
- 2026Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Modelscited by 3
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localizationcited by 2
- 2026A Difference-in-Difference Approach to Detecting AI-Generated Imagescited by 2
- 2026Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedbackcited by 2
8 more
- 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detectioncited by 1
- 2026Evidence-Grounded Forensic Reasoning for Detecting and Grounding Multi-Modal Media Manipulationcited by 1
- 2026Anchor-Regularized Adaptation for Generalizable AI-Generated Image Detection with DINOv3cited by 1
- 2026NormGuard: Reward-Preserving Norm Constraints in Flow-Matching Reinforcement Learningcited by 0
- 2026Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusioncited by 0
- 2026Editable Visual Designcited by 0
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videoscited by 0
- 2026From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detectioncited by 0
- 2026From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detection28 Sep 2026
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos25 Sep 2026
- 2026Editable Visual Design3 Sep 2026
- 2026Anchor-Regularized Adaptation for Generalizable AI-Generated Image Detection with DINOv315 Aug 2026
- 2026Evidence-Grounded Forensic Reasoning for Detecting and Grounding Multi-Modal Media Manipulation8 Aug 2026
- 2026Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusion30 Jul 2026
- 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection28 Jul 2026
- 2026NormGuard: Reward-Preserving Norm Constraints in Flow-Matching Reinforcement Learning26 Jun 2026
- 2026Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models14 Jun 2026
- 2026Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback4 Jun 2026
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection28 May 2026
- 2026ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representation15 May 2026
8 more
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localization13 May 2026
- 2026AgentFoX: LLM Agent-Guided Fusion with eXplainability for AI-Generated Image Detection24 Mar 2026
- 2026A Difference-in-Difference Approach to Detecting AI-Generated Images27 Feb 2026
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization15 Feb 2026
- 2025AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignment7 Dec 2025
- 2025RealGen: Photorealistic Text-to-Image Generation via Detector-Guided Rewards29 Nov 2025
- 2025DGS-Net: Distillation-Guided Gradient Surgery for CLIP Fine-Tuning in AI-Generated Image Detection17 Nov 2025
- 2025DINO-Detect: A Simple yet Effective Framework for Blur-Robust AI-Generated Image Detection16 Nov 2025
- 2025DGS-Net: Distillation-Guided Gradient Surgery for CLIP Fine-Tuning in AI-Generated Image Detectioncited by 5
- 2026A Difference-in-Difference Approach to Detecting AI-Generated Imagescited by 2
- 2026NormGuard: Reward-Preserving Norm Constraints in Flow-Matching Reinforcement Learningcited by 0
- 2026Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusioncited by 0
- 2026Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusion30 Jul 2026
- 2026NormGuard: Reward-Preserving Norm Constraints in Flow-Matching Reinforcement Learning26 Jun 2026
- 2026A Difference-in-Difference Approach to Detecting AI-Generated Images27 Feb 2026
- 2025DGS-Net: Distillation-Guided Gradient Surgery for CLIP Fine-Tuning in AI-Generated Image Detection17 Nov 2025
- 2026ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representationcited by 3
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localizationcited by 2
- 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detectioncited by 1
- 2026Evidence-Grounded Forensic Reasoning for Detecting and Grounding Multi-Modal Media Manipulationcited by 1
- 2026Evidence-Grounded Forensic Reasoning for Detecting and Grounding Multi-Modal Media Manipulation8 Aug 2026
- 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection28 Jul 2026
- 2026ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representation15 May 2026
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization15 Feb 2026
- 2025RealGen: Photorealistic Text-to-Image Generation via Detector-Guided Rewardscited by 12
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localizationcited by 8
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detectioncited by 4
- 2026Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedbackcited by 2
- 2026Anchor-Regularized Adaptation for Generalizable AI-Generated Image Detection with DINOv3cited by 1
- 2026Editable Visual Designcited by 0
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videoscited by 0
- 2026From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detectioncited by 0
- 2026From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detection28 Sep 2026
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos25 Sep 2026
- 2026Editable Visual Design3 Sep 2026
- 2026Anchor-Regularized Adaptation for Generalizable AI-Generated Image Detection with DINOv315 Aug 2026
- 2026Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback4 Jun 2026
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection28 May 2026
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localization13 May 2026
- 2025RealGen: Photorealistic Text-to-Image Generation via Detector-Guided Rewards29 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Towards Explainable Fake Image Detection with Multi-Modal Large Language Models
- 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs
- 2024FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Models
- 2025REVEAL -- Reasoning and Evaluation of Visual Evidence through Aligned Language
- 2026SPARED: Reasoning-Based AI-Generated Image Detection via Adversarially Edited Data
- 2025Explainable Detection of AI-Generated Images with Artifact Localization Using Faster-Than-Lies and Vision-Language Models for Edge Devices
- 2026When Understanding Becomes a Risk: Authenticity and Safety Risks in the Emerging Image Generation Paradigm
- 2026Seeing Is Believing? A Benchmark for Multimodal Large Language Models on Visual Illusions and Anomalies