Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detection
Not on the map. Why?
Abstract (arXiv)
The rapid development of Artificial Intelligence Generated Content (AIGC) techniques has enabled the creation of high-quality synthetic content, but it also raises significant security concerns. Current detection methods face two major limitations: (1) the lack of multidimensional explainable datasets for generated images and videos. Existing open-source datasets (e.g., WildFake, GenVideo) rely on oversimplified binary annotations, which restrict the explainability and trustworthiness of trained detectors. (2) Prior MLLM-based forgery detectors (e.g., FakeVLM) exhibit insufficiently fine-grained interpretability in their step-by-step reasoning, which hinders reliable localization and explanation. To address these challenges, we introduce Ivy-Fake, the first large-scale multimodal benchmark for explainable AIGC detection. It consists of over 106K richly annotated training samples (images and videos) and 5,000 manually verified evaluation examples, sourced from multiple generative models and real world datasets through a carefully designed pipeline to ensure both diversity and quality. Furthermore, we propose Ivy-xDetector, a reinforcement learning model based on Group Relative Policy Optimization (GRPO), capable of producing explainable reasoning chains and achieving robust performance across multiple synthetic content detection benchmarks. Extensive experiments demonstrate the superiority of our dataset and confirm the effectiveness of our approach. Notably, our method improves performance on GenImage from 86.88% to 96.32%, surpassing prior state-of-the-art methods by a clear margin.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 55 of its 111 references that are in the map. First posted on arXiv 1 Jun 2025.
Builds on
55 of 111 references.
References · 55
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Visual Instruction Tuningcited by 7,869
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2025Qwen2.5-VL Technical Reportcited by 5,587
38 more
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2017Certified Defenses for Data Poisoning Attackscited by 303
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
- 2025Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learningcited by 81
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 61
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
- 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?cited by 51
- 2025Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodalitycited by 50
- 2023Perceptual Artifacts Localization for Image Synthesis Taskscited by 43
- 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
- 2023Less is More: Focus Attention for Efficient DETRcited by 38
- 2023GenDet: Towards Good Generalizations for AI-Generated Image Detectioncited by 36
- 2024Mesoscopic Insights: Orchestrating Multi-scale & Hybrid Architecture for Image Manipulation Localizationcited by 35
- 2022Explaining Deepfake Detection by Analysing Image Matchingcited by 34
- 2025ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localizationcited by 22
- 2024Revisiting Tampered Scene Text Detection in the Era of Generative AIcited by 21
- 2024Bi-LORA: A Vision-Language Approach for Synthetic Image Detectioncited by 20
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 10; 2026: 24.
34 papers.
Sort:
By area:
- 2025Skyra: AI-Generated Video Detection via Grounded Artifact Reasoningcited by 25
- 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoningcited by 23
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detectioncited by 20
- 2026VideoVeritas: AI-Generated Video Detection via Perception Pretext Reinforcement Learningcited by 11
- 2025MIRAGE: Towards AI-Generated Image Detection in the Wildcited by 8
- 2025Semantic Visual Anomaly Detection and Reasoning in AI-Generated Imagescited by 8
- 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detectioncited by 8
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localizationcited by 8
- 2025AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignmentcited by 4
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detectioncited by 4
- 2025RobustSora: De-Watermarked Benchmark for Robust AI-Generated Video Detectioncited by 3
- 2026AgentFoX: LLM Agent-Guided Fusion with eXplainability for AI-Generated Image Detectioncited by 3
22 more
- 2026Rethinking the Readout: Unlocking Video Backbones for AI-Generated Video Detectioncited by 2
- 2026UniMoMo: Expert Merging-Based MoE Acceleration for Large Recommendation Modelscited by 2
- 2025METER: Multi-modal Evidence-based Thinking and Explainable Reasoning -- Algorithm and Benchmarkcited by 1
- 2025SpineBench: A Clinically Salient, Level-Aware Benchmark Powered by the SpineMed-450k Corpuscited by 1
- 2025Grab-3D: Detecting AI-Generated Videos from 3D Geometric Temporal Consistencycited by 1
- 2026GenVideoLens: Where LVLMs Fall Short in AI-Generated Video Detection?cited by 1
- 2026Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detectioncited by 1
- 2026DiscourseFlip: An Oblique Discourse-Level Opinion Manipulation Attack against Black-box Retrieval-Augmented Generationcited by 1
- 2026AIGC Video Detection based on the fusion of spatial-frequency-optical flow multimodal featurescited by 1
- 2026Detecting AI-Generated Videos with Spiking Neural Networkscited by 0
- 2026TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agentscited by 0
- 2026Specialist-Generalist Fusion with Outcome-Supervised Rationales for Deepfake Detectioncited by 0
- 2026Explainable Forensics of Manipulated Segments in Untrimmed Long Videoscited by 0
- 2026Detect Early, Escalate Rarely: Anytime Detection of AI-Generated Video from the Compressed Bitstreamcited by 0
- 2026Can Vision-Language Models Reason about AI Edits in Images?cited by 0
- 2026Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detectioncited by 0
- 2026TUE-Detector: A Tool-Using Expert MLLM-Based Detector for AI-Generated Videoscited by 0
- 2026FACT: A Forensic Agent with Compiled Tool-Use Trajectories for AI-Generated Image Detectioncited by 0
- 2026UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learningcited by 0
- 2026IVT-Guard: All-in-One Reasoning Model for AI-Generated Content Detectioncited by 0
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligencecited by 0
- 2026Typographic Attack Against VLM-based AI-generated Image Detectioncited by 0
- 2026Typographic Attack Against VLM-based AI-generated Image Detection30 Sep 2026
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026IVT-Guard: All-in-One Reasoning Model for AI-Generated Content Detection27 Sep 2026
- 2026UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning25 Sep 2026
- 2026FACT: A Forensic Agent with Compiled Tool-Use Trajectories for AI-Generated Image Detection5 Sep 2026
- 2026TUE-Detector: A Tool-Using Expert MLLM-Based Detector for AI-Generated Videos31 Aug 2026
- 2026AIGC Video Detection based on the fusion of spatial-frequency-optical flow multimodal features17 Aug 2026
- 2026Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection17 Aug 2026
- 2026UniMoMo: Expert Merging-Based MoE Acceleration for Large Recommendation Models9 Aug 2026
- 2026Can Vision-Language Models Reason about AI Edits in Images?30 Jul 2026
- 2026Detect Early, Escalate Rarely: Anytime Detection of AI-Generated Video from the Compressed Bitstream21 Jul 2026
- 2026Rethinking the Readout: Unlocking Video Backbones for AI-Generated Video Detection16 Jul 2026
22 more
- 2026Explainable Forensics of Manipulated Segments in Untrimmed Long Videos1 Jun 2026
- 2026DiscourseFlip: An Oblique Discourse-Level Opinion Manipulation Attack against Black-box Retrieval-Augmented Generation31 May 2026
- 2026Specialist-Generalist Fusion with Outcome-Supervised Rationales for Deepfake Detection29 May 2026
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection28 May 2026
- 2026Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detection21 May 2026
- 2026TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents16 May 2026
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localization13 May 2026
- 2026Detecting AI-Generated Videos with Spiking Neural Networks7 May 2026
- 2026AgentFoX: LLM Agent-Guided Fusion with eXplainability for AI-Generated Image Detection24 Mar 2026
- 2026GenVideoLens: Where LVLMs Fall Short in AI-Generated Video Detection?19 Mar 2026
- 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detection10 Feb 2026
- 2026VideoVeritas: AI-Generated Video Detection via Perception Pretext Reinforcement Learning9 Feb 2026
- 2025Skyra: AI-Generated Video Detection via Grounded Artifact Reasoning17 Dec 2025
- 2025Grab-3D: Detecting AI-Generated Videos from 3D Geometric Temporal Consistency15 Dec 2025
- 2025RobustSora: De-Watermarked Benchmark for Robust AI-Generated Video Detection11 Dec 2025
- 2025AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignment7 Dec 2025
- 2025Semantic Visual Anomaly Detection and Reasoning in AI-Generated Images11 Oct 2025
- 2025SpineBench: A Clinically Salient, Level-Aware Benchmark Powered by the SpineMed-450k Corpus3 Oct 2025
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detection29 Sep 2025
- 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoning28 Aug 2025
- 2025MIRAGE: Towards AI-Generated Image Detection in the Wild17 Aug 2025
- 2025METER: Multi-modal Evidence-based Thinking and Explainable Reasoning -- Algorithm and Benchmark22 Jul 2025
- 2025Skyra: AI-Generated Video Detection via Grounded Artifact Reasoningcited by 25
- 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoningcited by 23
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detectioncited by 20
- 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detectioncited by 8
- 2026Can Vision-Language Models Reason about AI Edits in Images?cited by 0
- 2026IVT-Guard: All-in-One Reasoning Model for AI-Generated Content Detectioncited by 0
- 2026IVT-Guard: All-in-One Reasoning Model for AI-Generated Content Detection27 Sep 2026
- 2026Can Vision-Language Models Reason about AI Edits in Images?30 Jul 2026
- 2026Fake-HR1: Rethinking Reasoning of Vision Language Model for Synthetic Image Detection10 Feb 2026
- 2025Skyra: AI-Generated Video Detection via Grounded Artifact Reasoning17 Dec 2025
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detection29 Sep 2025
- 2025Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoning28 Aug 2025
- 2025MIRAGE: Towards AI-Generated Image Detection in the Wildcited by 8
- 2025Semantic Visual Anomaly Detection and Reasoning in AI-Generated Imagescited by 8
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localizationcited by 8
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detectioncited by 4
- 2026Rethinking the Readout: Unlocking Video Backbones for AI-Generated Video Detectioncited by 2
- 2025METER: Multi-modal Evidence-based Thinking and Explainable Reasoning -- Algorithm and Benchmarkcited by 1
- 2025SpineBench: A Clinically Salient, Level-Aware Benchmark Powered by the SpineMed-450k Corpuscited by 1
- 2026GenVideoLens: Where LVLMs Fall Short in AI-Generated Video Detection?cited by 1
- 2026Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detectioncited by 1
- 2026AIGC Video Detection based on the fusion of spatial-frequency-optical flow multimodal featurescited by 1
- 2026Detecting AI-Generated Videos with Spiking Neural Networkscited by 0
- 2026TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agentscited by 0
12 most cited of 20 All 20 (JSON)
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning25 Sep 2026
- 2026FACT: A Forensic Agent with Compiled Tool-Use Trajectories for AI-Generated Image Detection5 Sep 2026
- 2026TUE-Detector: A Tool-Using Expert MLLM-Based Detector for AI-Generated Videos31 Aug 2026
- 2026AIGC Video Detection based on the fusion of spatial-frequency-optical flow multimodal features17 Aug 2026
- 2026Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection17 Aug 2026
- 2026Detect Early, Escalate Rarely: Anytime Detection of AI-Generated Video from the Compressed Bitstream21 Jul 2026
- 2026Rethinking the Readout: Unlocking Video Backbones for AI-Generated Video Detection16 Jul 2026
- 2026Explainable Forensics of Manipulated Segments in Untrimmed Long Videos1 Jun 2026
- 2026Specialist-Generalist Fusion with Outcome-Supervised Rationales for Deepfake Detection29 May 2026
- 2026FakeVLM-R1: Internalizing Physical Laws via CoT for Synthetic Image Detection28 May 2026
- 2026Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detection21 May 2026
12 newest of 20 All 20 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026CoCoVideo: The High-Quality Commercial-Model-Based Contrastive Benchmark for AI-Generated Video Detection
- 2025FakeScope: Large Multimodal Expert Model for Transparent AI-Generated Image Forensics
- 2025AEGIS: Authenticity Evaluation Benchmark for AI-Generated Video Sequences
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectors
- 2025BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation
- 2025So-Fake: Benchmarking and Explaining Social Media Image Forgery Detection
- 2026Simplicity Prevails: The Emergence of Generalizable AIGI Detection in Visual Foundation Models
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models