mlsanityData to 14 Oct 2026

FakeScope: Large Multimodal Expert Model for Transparent AI-Generated Image Forensics

arXiv 2503.24267 ↗First posted 31 Mar 2025cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

The rapid and unrestrained advancement of generative artificial intelligence (AI) presents a double-edged sword. While enabling unprecedented creativity, it also facilitates the generation of highly convincing content, undermining societal trust. As image generation techniques become increasingly sophisticated, detecting synthetic images is no longer just a binary task--it necessitates explainable methodologies to enhance trustworthiness and transparency. However, existing detection models primarily focus on classification, offering limited explanatory insights. To address these limitations, we propose FakeScope, an expert large multimodal model (LMM) tailored for AI-generated image forensics, which not only identifies synthetic images with high accuracy but also delivers rich query-contingent forensic insights. At the foundation of our approach is FakeChain, a large-scale dataset containing structured forensic reasoning based on visual trace evidence, constructed via a human-machine collaborative framework. Then we develop FakeInstruct, the largest multimodal instruction tuning dataset to date, comprising two million visual instructions that instill nuanced forensic awareness into LMMs. Empowered by FakeInstruct, FakeScope achieves state-of-the-art performance in both closed-ended and open-ended forensic scenarios. It can accurately distinguish synthetic images, provide coherent explanations, discuss fine-grained forgery artifacts, and suggest actionable enhancement strategies. Notably, despite being trained exclusively on qualitative hard labels, FakeScope demonstrates remarkable zero-shot quantitative detection capability via our proposed token-based probability estimation strategy. Furthermore, it shows robust generalization across unseen image generators and performs reliably under in-the-wild scenarios.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 68 of its 86 references that are in the map. First posted on arXiv 31 Mar 2025.

Builds on

68 of 86 references.

References · 68

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2023Visual Instruction Tuningcited by 7,869
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  11. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  12. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
38 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  2. 2023Mistral 7Bcited by 3,164
  3. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  5. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  6. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  7. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  8. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  9. 2024A Survey on LLM-as-a-Judgecited by 1,423
  10. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  11. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  12. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
  13. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
  14. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  15. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
  16. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  17. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
  18. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  19. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  20. 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
  21. 2023OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documentscited by 316
  22. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
  23. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  24. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
  25. 2022Can language models learn from explanations in context?cited by 249
  26. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  27. 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
  28. 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 164
  29. 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
  30. 2019FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signalscited by 145
  31. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 135
  32. 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
  33. 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
  34. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
  35. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
  36. 2024Why are Visually-Grounded Language Models Bad at Image Classification?cited by 102
  37. 2021Trustworthy AI: A Computational Perspectivecited by 93
  38. 2020Improving Image Captioning with Better Use of Captionscited by 84

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 7.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025REVEAL: Reasoning-Enhanced Forensic Evidence Analysis for Explainable AI-Generated Image Detection
  2. 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics
  3. 2025ForenX: Towards Explainable AI-Generated Image Detection with Multimodal Large Language Models
  4. 2025Toward Generalizable Forgery Detection and Reasoning
  5. 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detection
  6. 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectors
  7. 2025VERITAS: Verification and Explanation of Realness in Images for Transparency in AI Systems
  8. 2026ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection