mlsanityData to 14 Oct 2026

INSIGHT: An Interpretable Neural Vision-Language Framework for Reasoning of Generative Artifacts

arXiv 2511.22351 ↗First posted 27 Nov 2025cs.CVcited by 1

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

The growing realism of AI-generated images produced by recent GAN and diffusion models has intensified concerns over the reliability of visual media. Yet, despite notable progress in deepfake detection, current forensic systems degrade sharply under real-world conditions such as severe downsampling, compression, and cross-domain distribution shifts. Moreover, most detectors operate as opaque classifiers, offering little insight into why an image is flagged as synthetic, undermining trust and hindering adoption in high-stakes settings. We introduce INSIGHT (Interpretable Neural Semantic and Image-based Generative-forensic Hallucination Tracing), a unified multimodal framework for robust detection and transparent explanation of AI-generated images, even at extremely low resolutions (16x16 - 64x64). INSIGHT combines hierarchical super-resolution for amplifying subtle forensic cues without inducing misleading artifacts, Grad-CAM driven multi-scale localization to reveal spatial regions indicative of generative patterns, and CLIP-guided semantic alignment to map visual anomalies to human-interpretable descriptors. A vision-language model is then prompted using a structured ReAct + Chain-of-Thought protocol to produce consistent, fine-grained explanations, verified through a dual-stage G-Eval + LLM-as-a-judge pipeline to minimize hallucinations and ensure factuality. Across diverse domains, including animals, vehicles, and abstract synthetic scenes, INSIGHT substantially improves both detection robustness and explanation quality under extreme degradation, outperforming prior detectors and black-box VLM baselines. Our results highlight a practical path toward transparent, reliable AI-generated image forensics and establish INSIGHT as a step forward in trustworthy multimodal content verification.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 60 of its 111 references that are in the map. First posted on arXiv 27 Nov 2025.

Builds on

60 of 111 references.

References · 60

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  7. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  8. 2023Visual Instruction Tuningcited by 7,869
  9. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  10. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  11. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  12. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
38 more
  1. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  3. 2013Auto-Encoding Variational Bayescited by 4,053
  4. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  5. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  6. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  7. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  8. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
  9. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  10. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  11. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  12. 2020Pre-Trained Image Processing Transformercited by 893
  13. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  14. 2015Deep Learning and the Information Bottleneck Principlecited by 802
  15. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 681
  16. 2017Wasserstein GANcited by 639
  17. 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 565
  18. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  19. 2021VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Expertscited by 425
  20. 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 334
  21. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
  22. 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
  23. 2017VITON: An Image-based Virtual Try-on Networkcited by 286
  24. 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
  25. 2020What makes fake images detectable? Understanding properties that generalizecited by 273
  26. 2017Learning a Single Convolutional Super-Resolution Network for Multiple Degradationscited by 228
  27. 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
  28. 2018Do GANs leave artificial fingerprints?cited by 190
  29. 2020Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claimscited by 165
  30. 2020The DeepFake Detection Challenge (DFDC) Datasetcited by 132
  31. 2023CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Imagescited by 84
  32. 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
  33. 2022Reference-based Image Super-Resolution with Deformable Attention Transformercited by 51
  34. 2024DRCT: Saving Image Super-resolution away from Information Bottleneckcited by 40
  35. 2014Generative Adversarial Networkscited by 33
  36. 2024Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMscited by 28
  37. 2024Mixture of Low-rank Experts for Transferable AI-Generated Image Detectioncited by 21
  38. 2018Identification of Deep Network Generated Images Using Disparities in Color Componentscited by 18

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection
  2. 2026Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
  3. 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs
  4. 2026LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection
  5. 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection
  6. 2025REVEAL -- Reasoning and Evaluation of Visual Evidence through Aligned Language
  7. 2026Perception, Verdict, and Evolution: Hindsight-Driven Self-Refining Forensics Agent for AI-Generated Image Detection
  8. 2025Locate-Then-Examine: Grounded Region Reasoning Improves Detection of AI-Generated Images