FakeScope: Large Multimodal Expert Model for Transparent AI-Generated Image Forensics
Not on the map. Why?
Abstract (arXiv)
The rapid and unrestrained advancement of generative artificial intelligence (AI) presents a double-edged sword. While enabling unprecedented creativity, it also facilitates the generation of highly convincing content, undermining societal trust. As image generation techniques become increasingly sophisticated, detecting synthetic images is no longer just a binary task--it necessitates explainable methodologies to enhance trustworthiness and transparency. However, existing detection models primarily focus on classification, offering limited explanatory insights. To address these limitations, we propose FakeScope, an expert large multimodal model (LMM) tailored for AI-generated image forensics, which not only identifies synthetic images with high accuracy but also delivers rich query-contingent forensic insights. At the foundation of our approach is FakeChain, a large-scale dataset containing structured forensic reasoning based on visual trace evidence, constructed via a human-machine collaborative framework. Then we develop FakeInstruct, the largest multimodal instruction tuning dataset to date, comprising two million visual instructions that instill nuanced forensic awareness into LMMs. Empowered by FakeInstruct, FakeScope achieves state-of-the-art performance in both closed-ended and open-ended forensic scenarios. It can accurately distinguish synthetic images, provide coherent explanations, discuss fine-grained forgery artifacts, and suggest actionable enhancement strategies. Notably, despite being trained exclusively on qualitative hard labels, FakeScope demonstrates remarkable zero-shot quantitative detection capability via our proposed token-based probability estimation strategy. Furthermore, it shows robust generalization across unseen image generators and performs reliably under in-the-wild scenarios.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 68 of its 86 references that are in the map. First posted on arXiv 31 Mar 2025.
Builds on
68 of 86 references.
References · 68
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Visual Instruction Tuningcited by 7,869
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
38 more
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2023Mistral 7Bcited by 3,164
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
- 2023OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documentscited by 316
- 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2022Can language models learn from explanations in context?cited by 249
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
- 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 164
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 135
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2024Why are Visually-Grounded Language Models Bad at Image Classification?cited by 102
- 2021Trustworthy AI: A Computational Perspectivecited by 93
- 2020Improving Image Captioning with Better Use of Captionscited by 84
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025BusterX++: Towards Unified Cross-Modal AI-Generated Content Detection and Explanation with MLLMcited by 29
- 2025Rethinking Cross-Generator Image Forgery Detection through DINOv3cited by 8
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localizationcited by 8
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detectioncited by 6
- 2025So-Fake: Benchmarking and Explaining Social Media Image Forgery Detectioncited by 5
- 2025Code-in-the-Loop Forensics: Agentic Tool Use for Image Forgery Detectioncited by 4
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detectioncited by 4
- 2026Unveiling Perceptual Artifacts: A Fine-Grained Benchmark for Interpretable AI-Generated Image Detectioncited by 3
- 2026AgentFoX: LLM Agent-Guided Fusion with eXplainability for AI-Generated Image Detectioncited by 3
- 2026Decoupling Vision and Language: Codebook Anchored Visual Adaptationcited by 0
- 2026Are a Thousand Words Better Than a Single Picture? Beyond Images -- A Framework for Multi-Modal Knowledge Graph Dataset Enrichmentcited by 0
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection28 May 2026
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localization13 May 2026
- 2026AgentFoX: LLM Agent-Guided Fusion with eXplainability for AI-Generated Image Detection24 Mar 2026
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detection18 Mar 2026
- 2026Are a Thousand Words Better Than a Single Picture? Beyond Images -- A Framework for Multi-Modal Knowledge Graph Dataset Enrichment17 Mar 2026
- 2026Decoupling Vision and Language: Codebook Anchored Visual Adaptation23 Feb 2026
- 2026Unveiling Perceptual Artifacts: A Fine-Grained Benchmark for Interpretable AI-Generated Image Detection27 Jan 2026
- 2025Code-in-the-Loop Forensics: Agentic Tool Use for Image Forgery Detection18 Dec 2025
- 2025Rethinking Cross-Generator Image Forgery Detection through DINOv327 Nov 2025
- 2025BusterX++: Towards Unified Cross-Modal AI-Generated Content Detection and Explanation with MLLM19 Jul 2025
- 2025So-Fake: Benchmarking and Explaining Social Media Image Forgery Detection24 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025REVEAL: Reasoning-Enhanced Forensic Evidence Analysis for Explainable AI-Generated Image Detection
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics
- 2025ForenX: Towards Explainable AI-Generated Image Detection with Multimodal Large Language Models
- 2025Toward Generalizable Forgery Detection and Reasoning
- 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detection
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectors
- 2025VERITAS: Verification and Explanation of Realness in Images for Transparency in AI Systems
- 2026ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection