FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection
Not on the map. Why?
Abstract (arXiv)
The development of generative artificial intelligence technologies has propelled the visual realism of synthetic images to an unprecedented level. Although current interpretable detection methods based on Large Multimodal Models (LMMs) have made certain progress, they still rely on imitation learning derived from massive volumes of forged data. Consequently, they lack genuine causal reasoning capabilities and are prone to explanatory hallucinations. To overcome this bottleneck, we propose FakeVLM-R1, aiming to endow the model with human-like critical thinking capabilities when performing synthetic detection tasks. Building upon Supervised Fine-Tuning (SFT), this framework integrates Group Relative Policy Optimization (GRPO) with a Critical Thinking Chain-of-Thought (CoT) mechanism. During the inference phase, the model executes a "bidirectional dialectical reasoning" process: while proposing a forgery hypothesis, it must simultaneously invoke physical commonsense to construct an authenticity counter-proof. Furthermore, we constructed the FakeClue++ dataset with high-quality samples, which extensively introduces annotations guided by the physical laws of authentic images, providing a unified authenticity anchor for the model. Experiments confirm that FakeVLM-R1 achieves SOTA performance the evaluated models across multiple benchmarks. It not only achieves high-precision, logically interpretable detection but also resolves the over-rejection bias of existing methods against real images, demonstrating generalization and robustness against perturbations.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 54 of its 75 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
54 of 75 references.
References · 54
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Visual Instruction Tuningcited by 7,869
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2022Generative Adversarial Networkscited by 5,627
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
38 more
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2022On the detection of synthetic images generated by diffusion modelscited by 283
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 126
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2024Why are Visually-Grounded Language Models Bad at Image Classification?cited by 102
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
- 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
- 2022FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbationscited by 75
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 69
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2024Common Sense Reasoning for Deepfake Detectioncited by 65
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
- 2025Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitatecited by 63
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 61
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 61
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
- 2025SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Rewardcited by 45
- 2024A Single Simple Patch is All You Need for AI-generated Image Detectioncited by 44
- 2024FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Modelscited by 36
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detectioncited by 34
- 2025AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Modelscited by 33
- 2025BusterX++: Towards Unified Cross-Modal AI-Generated Content Detection and Explanation with MLLMcited by 29
- 2021Wavelet-Packets for Deepfake Image Analysis and Detectioncited by 25
- 2025Skyra: AI-Generated Video Detection via Grounded Artifact Reasoningcited by 25
- 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generationcited by 23
- 2023Detecting Generated Images by Real Images Onlycited by 20
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Veritas++: Value-aware On-Policy Distillation for Perception-Enhanced AIGI Detectioncited by 2
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understandingcited by 2
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videoscited by 0
- 2026MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Taskscited by 0
- 2026MAD-Guard: Controlled Study of Autoregressive Generation versus Direct Decision Interfaces for Closed Multimodal Forensic Tasks27 Sep 2026
- 2026ManiVid: Unified and Explainable Forensic Analysis of Manipulated Videos25 Sep 2026
- 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding23 Aug 2026
- 2026Veritas++: Value-aware On-Policy Distillation for Perception-Enhanced AIGI Detection29 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detection
- 2024Synthetic Photography Detection: A Visual Guidance for Identifying Synthetic Images Created by AI
- 2025DF-LLaVA: Unlocking MLLMs for Synthetic Image Detection via Knowledge Injection and Conflict-Driven Self-Reflection
- 2025Towards Explainable Fake Image Detection with Multi-Modal Large Language Models
- 2025So-Fake: Benchmarking and Explaining Social Media Image Forgery Detection
- 2025Cognitive Inception: Agentic Reasoning against Visual Deceptions by Injecting Skepticism
- 2026EviScene: Beyond "Is It AI?" for Agentic Image Factuality Assessment
- 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs