Semantic Visual Anomaly Detection and Reasoning in AI-Generated Images
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of AI-generated content (AIGC) has enabled the synthesis of visually convincing images; however, many such outputs exhibit subtle semantic anomalies, including unrealistic object configurations, violations of physical laws, or commonsense inconsistencies, which compromise the overall plausibility of the generated scenes. Detecting these semantic-level anomalies is essential for assessing the trustworthiness of AIGC media, especially in AIGC image analysis, explainable deepfake detection and semantic authenticity assessment. In this paper, we formalize semantic anomaly detection and reasoning for AIGC images and introduce AnomReason, a large-scale benchmark with structured annotations as quadruples (Name, Phenomenon, Reasoning, Severity). Annotations are produced by a modular multi-agent pipeline (AnomAgent) with lightweight human-in-the-loop verification, enabling scale while preserving quality. At construction time, AnomAgent processed approximately 4.17,B GPT-4o tokens, providing scale evidence for the resulting structured annotations. We further show that models fine-tuned on AnomReason achieve consistent gains over strong vision-language baselines under our proposed semantic matching metric (textitSemAP and textitSemF1). Applications to explainable deepfake detection and semantic reasonableness assessment of image generators demonstrate practical utility. In summary, AnomReason and AnomAgent serve as a foundation for measuring and improving the semantic plausibility of AI-generated images. We will release code, metrics, data, and task-aligned models to support reproducible research on semantic authenticity and interpretable AIGC forensics.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 38 of its 59 references that are in the map. First posted on arXiv 11 Oct 2025.
Builds on
38 of 59 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2024GPT-4o System Cardcited by 4,588
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
26 more
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2025Qwen-Image Technical Reportcited by 1,044
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
- 2024Long Context Transfer from Language to Visioncited by 515
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2023LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluationcited by 87
- 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 87
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 40
- 2024FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Modelscited by 36
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detectioncited by 34
- 2025AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Modelscited by 33
- 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoningcited by 23
- 2025Toward Generalizable Forgery Detection and Reasoningcited by 20
- 2025ForenX: Towards Explainable AI-Generated Image Detection with Multimodal Large Language Modelscited by 6
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detectioncited by 6
- 2026GenShield: Unified Detection and Artifact Correction for AI-Generated Imagescited by 1
- 2026Moir'e Video Authentication: A Physical Signature Against AI Video Generationcited by 0
- 2026Boosting Robust AIGI Detection with LoRA-based Pairwise Trainingcited by 0
- 2026Robustness of AI-Art Detectors under Generator Shiftcited by 0
- 2026Mandela-Bench: Multimodal Models Remember Canonical Images Instead of Seeing Themcited by 0
- 2026RED: Reconstruction Evolution Dynamics for Generalizable AI-Generated Image Detectioncited by 0
- 2026EviScene: Beyond "Is It AI?" for Agentic Image Factuality Assessmentcited by 0
- 2026EviScene: Beyond "Is It AI?" for Agentic Image Factuality Assessment10 Oct 2026
- 2026RED: Reconstruction Evolution Dynamics for Generalizable AI-Generated Image Detection29 Sep 2026
- 2026Mandela-Bench: Multimodal Models Remember Canonical Images Instead of Seeing Them26 Sep 2026
- 2026Robustness of AI-Art Detectors under Generator Shift12 Aug 2026
- 2026GenShield: Unified Detection and Artifact Correction for AI-Generated Images15 May 2026
- 2026Boosting Robust AIGI Detection with LoRA-based Pairwise Training14 Apr 2026
- 2026Moir'e Video Authentication: A Physical Signature Against AI Video Generation2 Apr 2026
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detection18 Mar 2026