mlsanityData to 7 Oct 2026

Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection

arXiv 2602.01854 ↗First posted 2 Feb 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

In multimodal misinformation, deception usually arises not just from pixel-level manipulations in an image, but from the semantic and contextual claim jointly expressed by the image-text pair. Yet most deepfake detectors, engineered to detect pixel-level forgeries, do not account for claim-level meaning, despite their growing integration in automated fact-checking (AFC) pipelines. This raises a central scientific and practical question: Do pixel-level detectors contribute useful signal for verifying image-text claims, or do they instead introduce misleading authenticity priors that undermine evidence-based reasoning? We provide the first systematic analysis of deepfake detectors in the context of multimodal misinformation detection. Using two complementary benchmarks, MMFakeBench and DGM4, we evaluate: (1) state-of-the-art image-only deepfake detectors, (2) an evidence-driven fact-checking system that performs tool-guided retrieval via Monte Carlo Tree Search (MCTS) and engages in deliberative inference through Multi-Agent Debate (MAD), and (3) a hybrid fact-checking system that injects detector outputs as auxiliary evidence. Results across both benchmark datasets show that deepfake detectors offer limited standalone value, achieving F1 scores in the range of 0.26-0.53 on MMFakeBench and 0.33-0.49 on DGM4, and that incorporating their predictions into fact-checking pipelines consistently reduces performance by 0.04-0.08 F1 due to non-causal authenticity assumptions. In contrast, the evidence-centric fact-checking system achieves the highest performance, reaching F1 scores of approximately 0.81 on MMFakeBench and 0.55 on DGM4. Overall, our findings demonstrate that multimodal claim verification is driven primarily by semantic understanding and external evidence, and that pixel-level artifact signals do not reliably enhance reasoning over real-world image-text misinformation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

25 of 56 references.

References · 25

  1. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  2. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
  3. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  4. 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 180
  5. 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
  6. 2024SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detectioncited by 73
  7. 2023Multimodal Automated Fact-Checking: A Surveycited by 51
  8. 2024Can We Leave Deepfake Data Behind in Training Deepfake Detector?cited by 48
  9. 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 42
  10. 2024Faster Than Lies: Real-time Deepfake Detection using Binary Neural Networkscited by 27
  11. 2021COSMOS: Catching Out-of-Context Misinformation with Self-Supervised Learningcited by 26
  12. 2024Multimodal Misinformation Detection using Large Vision-Language Modelscited by 21
13 more
  1. 2025Deepfake Detection that Generalizes Across Benchmarkscited by 20
  2. 2023RED-DOT: Multimodal Fact-checking via Relevant Evidence Detectioncited by 18
  3. 2024Can LLMs Improve Multimodal Fact-Checking by Asking Relevant Questions?cited by 17
  4. 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
  5. 2025TRUST-VL: An Explainable News Assistant for General Multimodal Misinformation Detectioncited by 10
  6. 2024Crafting Synthetic Realities: Examining Visual Realism and Misinformation Potential of Photorealistic AI-Generated Imagescited by 6
  7. 2025RAMA: Retrieval-Augmented Multi-Agent Framework for Misinformation Detection in Multimodal Fact-Checkingcited by 5
  8. 2026VeriTaS: The First Dynamic Benchmark for Multimodal Automated Fact-Checkingcited by 5
  9. 2025T^2Agent A Tool-augmented Multimodal Misinformation Detection Agent with Monte Carlo Tree Searchcited by 4
  10. 2025Deepfake Detection of Face Images based on a Convolutional Neural Networkcited by 3
  11. 2024Image-Text Out-Of-Context Detection Using Synthetic Multimodal Misinformationcited by 2
  12. 2024LookupForensics: A Large-Scale Multi-Task Dataset for Multi-Phase Image-Based Fact Verificationcited by 2
  13. 2025Fact-Checking with Contextual Narratives: Leveraging Retrieval-Augmented LLMs for Social Media Analysiscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026MIC: Explaining Image-Claim Inconsistencies in AI-Generated Multimodal Misinformation
  2. 2025Towards Unified Multimodal Misinformation Detection in Social Media: A Benchmark Dataset and Baseline
  3. 2026RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild
  4. 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMs
  5. 2025MERIT: Modular Framework for Multimodal Misinformation Detection with Web-Grounded Reasoning
  6. 2025Debunk and Infer: Multimodal Fake News Detection via Diffusion-Generated Evidence and LLM Reasoning
  7. 2026DIVER: Dynamic Iterative Visual Evidence Reasoning for Multimodal Fake News Detection
  8. 2024FakeBench: Probing Explainable Fake Image Detection via Large Multimodal Models