mlsanityData to 14 Oct 2026

Toward Generalizable Forgery Detection and Reasoning

arXiv 2503.21210 ↗First posted 27 Mar 2025cs.CVcited by 20

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Accurate and interpretable detection of AI-generated images is essential for mitigating risks associated with AI misuse. However, the substantial domain gap among generative models makes it challenging to develop a generalizable forgery detection model. Moreover, since every pixel in an AI-generated image is synthesized, traditional saliency-based forgery explanation methods are not well suited for this task. To address these challenges, we formulate detection and explanation as a unified Forgery Detection and Reasoning task (FDR-Task), leveraging Multi-Modal Large Language Models (MLLMs) to provide accurate detection through reliable reasoning over forgery attributes. To facilitate this task, we introduce the Multi-Modal Forgery Reasoning dataset (MMFR-Dataset), a large-scale dataset containing 120K images across 10 generative models, with 378K reasoning annotations on forgery attributes, enabling comprehensive evaluation of the FDR-Task. Furthermore, we propose FakeReasoning, a forgery detection and reasoning framework with three key components: 1) a dual-branch visual encoder that integrates CLIP and DINO to capture both high-level semantics and low-level artifacts; 2) a Forgery-Aware Feature Fusion Module that leverages DINO's attention maps and cross-attention mechanisms to guide MLLMs toward forgery-related clues; 3) a Classification Probability Mapper that couples language modeling and forgery detection, enhancing overall performance. Experiments across multiple generative models demonstrate that FakeReasoning not only achieves robust generalization but also outperforms state-of-the-art methods on both detection and reasoning tasks. The code is available at: https://github.com/PRIS-CV/FakeReasoning.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 68 of its 92 references that are in the map. First posted on arXiv 27 Mar 2025.

Builds on

68 of 92 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  2. 2024SegLLM: Multi-round Reasoning Segmentation24 Oct
  3. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
  4. 2023LISA: Reasoning Segmentation via Large Language Model1 Aug

Other references · 64

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  7. 2023Segment Anythingcited by 8,234
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 2023Visual Instruction Tuningcited by 7,869
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  11. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  12. 2025Qwen2.5-VL Technical Reportcited by 5,587
38 more
  1. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  2. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  3. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  5. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  7. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
  8. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  9. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  10. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
  11. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  12. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
  13. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  14. 2023DIRE for Diffusion-Generated Image Detectioncited by 390
  15. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 379
  16. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
  17. 2023GRES: Generalized Referring Expression Segmentationcited by 254
  18. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 228
  19. 2023SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefillscited by 193
  20. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  21. 2023OneLLM: One Framework to Align All Modalities with Languagecited by 187
  22. 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
  23. 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
  24. 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 164
  25. 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
  26. 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
  27. 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
  28. 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
  29. 2018Noiseprint: a CNN-based camera model fingerprintcited by 114
  30. 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
  31. 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
  32. 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 110
  33. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
  34. 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
  35. 2023From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Modelscited by 98
  36. 2024Common Sense Reasoning for Deepfake Detectioncited by 65
  37. 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
  38. 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 11.

20 papers.

Sort:

By area:

  1. 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoningcited by 23
  2. 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detectioncited by 20
  3. 2025Towards Explainable Fake Image Detection with Multi-Modal Large Language Modelscited by 8
  4. 2025Semantic Visual Anomaly Detection and Reasoning in AI-Generated Imagescited by 8
  5. 2025ThinkFake: Reasoning in Multimodal Large Language Models for AI-Generated Image Detectioncited by 7
  6. 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detectioncited by 6
  7. 2025Multimodal Conditional Information Bottleneck for Generalizable AI-Generated Image Detectioncited by 5
  8. 2025Locate-Then-Examine: Grounded Region Reasoning Improves Detection of AI-Generated Imagescited by 4
  9. 2025AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignmentcited by 4
  10. 2026Unveiling Perceptual Artifacts: A Fine-Grained Benchmark for Interpretable AI-Generated Image Detectioncited by 3
  11. 2025METER: Multi-modal Evidence-based Thinking and Explainable Reasoning -- Algorithm and Benchmarkcited by 1
  12. 2026EvolveReason: Self-Evolving Reasoning Paradigm for Explainable Deepfake Facial Image Identificationcited by 1
8 more
  1. 2026Perception, Verdict, and Evolution: Hindsight-Driven Self-Refining Forensics Agent for AI-Generated Image Detectioncited by 1
  2. 2026VGIF-Score: Interpretable and Diagnostic Evaluation of Spatio-Temporal Instruction Following in Video Generationcited by 1
  3. 2026Grounding and Explaining Visual Evidence for AI-Generated Image Detection in Human-Centric Scenescited by 1
  4. 2026FlexiGrad: Adaptive Gradient Modulation for Hierarchical Fine-Grained Classificationcited by 0
  5. 2026FakeIDet3-DB: Refining Digital Attacks and Patch Extraction for Secure ID Benchmarkingcited by 0
  6. 2026RAID: Towards Robust AI-Generated Image Detection with Bit-Reversed Imagescited by 0
  7. 2026VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removalcited by 0
  8. 2026Agentic Tool-Augmented Reasoning for Explainable Image Forgery Detectioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026ReAlign: Generalizable Image Forgery Detection via Reasoning-Aligned Representation
  2. 2025ForenX: Towards Explainable AI-Generated Image Detection with Multimodal Large Language Models
  3. 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs
  4. 2025Unlocking the Forgery Detection Potential of Vanilla MLLMs: A Novel Training-Free Pipeline
  5. 2026ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection
  6. 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization
  7. 2025REVEAL -- Reasoning and Evaluation of Visual Evidence through Aligned Language
  8. 2024A Hitchhikers Guide to Fine-Grained Face Forgery Detection Using Common Sense Reasoning