MIC: Explaining Image-Claim Inconsistencies in AI-Generated Multimodal Misinformation
Not on the map. Why?
Abstract (arXiv)
Claims paired with AI-generated images are a rapidly growing form of misinformation. Existing automated fact-checking (AFC) methods mainly treat this as a provenance problem, detecting low-level synthesis artifacts to decide whether an image is AI-generated. However, such methods do not verify what human fact-checkers often check: whether an image's content is consistent with the context implied by its accompanying claim. To address this gap, we introduce MIC (Multimodal Inconsistency Checking), an AFC framework that assists human fact-checkers by detecting AI-generated multimodal misinformation and explaining inconsistencies using world knowledge. MIC first uses supervised fine-tuning (SFT) for task adaptation and then applies Group Relative Policy Optimization (GRPO) to directly optimize component-level verifiable rewards for verdict prediction, inconsistency type classification, visual evidence description, and world-knowledge explanation. We further introduce MIC-Bench, a benchmark comprising 8,812 image-claim instances derived from 4,406 claims, where each claim is paired with an authentic image and an AI-generated counterpart that introduces a controlled contextual inconsistency. Compared with SFT alone, GRPO further improves Macro-F1 by 4.67 and 4.11 points in the in-distribution and out-of-distribution settings, respectively, while also improving the semantic similarity of visual evidence descriptions and world-knowledge explanations to reference annotations. Our code and data are available at https://github.com/UKPLab/arxiv2026-mic.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 74 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
29 of 74 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
17 more
- 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
- 2024SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detectioncited by 74
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learningcited by 57
- 2023Multimodal Automated Fact-Checking: A Surveycited by 53
- 2020Transform and Tell: Entity-Aware News Image Captioningcited by 52
- 2024AMMeBa: A Large-Scale Survey and Dataset of Media-Based Misinformation In-The-Wildcited by 27
- 2022There is a Time and Place for Reasoning Beyond the Imagecited by 22
- 2024MiRAGeNews: Multimodal Realistic AI-Generated News Detectioncited by 15
- 2025COVE: COntext and VEracity prediction for out-of-context imagescited by 14
- 2025Fact-R1: Towards Explainable Video Misinformation Detection with Deep Reasoningcited by 14
- 2024HEIE: MLLM-Based Hierarchical Explainable AIGC Image Implausibility Evaluatorcited by 13
- 2024Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?cited by 11
- 2025M4FC: a Multimodal, Multilingual, Multicultural, Multitask Real-World Fact-Checking Datasetcited by 7
- 2025Characterizing AI-Generated Misinformation on Social Mediacited by 5
- 2025DeeCLIP: A Robust and Generalizable Transformer-Based Framework for Detecting AI-Generated Imagescited by 4
- 2024Political Fact-Checking Efforts are Constrained by Deficiencies in Coverage, Speed, and Reachcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection
- 2026RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild
- 2025RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild
- 2024MFC-Bench: Benchmarking Multimodal Fact-Checking with Large Vision-Language Models
- 2026Multimodal Claim Extraction for Fact-Checking
- 2026Is a Picture Worth a Thousand Words? Adaptive Multimodal Fact-Checking with Visual Evidence Necessity
- 2026EviScene: Beyond "Is It AI?" for Agentic Image Factuality Assessment
- 2026Evidence Triangulation for Multimodal Fact-Checking in the Wild