mlsanityData to 14 Oct 2026

Multimodal Automated Fact-Checking: A Survey

arXiv 2305.13507 ↗First posted 22 May 2023cs.CL cs.AI cs.CVcited by 53

Not on the map. Why?

Abstract (arXiv)

Misinformation is often conveyed in multiple modalities, e.g. a miscaptioned image. Multimodal misinformation is perceived as more credible by humans, and spreads faster than its text-only counterparts. While an increasing body of research investigates automated fact-checking (AFC), previous surveys mostly focus on text. In this survey, we conceptualise a framework for AFC including subtasks unique to multimodal misinformation. Furthermore, we discuss related terms used in different communities and map them to our framework. We focus on four modalities prevalent in real-world fact-checking: text, image, audio, and video. We survey benchmarks and models, and discuss limitations and promising directions for future research

Key facts. Cited by 53 papers in the map (data through 14 Oct 2026). Builds on 89 of its 179 references that are in the map. First posted on arXiv 22 May 2023.

Builds on

89 of 179 references.

References · 89

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  7. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  8. 2017Mask R-CNNcited by 7,277
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  10. 2022Generative Adversarial Networkscited by 5,627
  11. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  12. 2014Going Deeper with Convolutionscited by 4,241
38 more
  1. 2013Auto-Encoding Variational Bayescited by 4,053
  2. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  3. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  4. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
  5. 2021A Survey on Automated Fact-Checkingcited by 378
  6. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
  7. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 320
  8. 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
  9. 2019On the Detection of Digital Face Manipulationcited by 260
  10. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
  11. 2020Explainable Automated Fact-Checking for Public Health Claimscited by 211
  12. 2019The Deepfake Detection Challenge (DFDC) Preview Datasetcited by 209
  13. 2021Visually Grounded Reasoning across Languages and Culturescited by 189
  14. 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
  15. 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
  16. 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
  17. 2018Learning Rich Features for Image Manipulation Detectioncited by 154
  18. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
  19. 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
  20. 2020Generating Fact Checking Explanationscited by 132
  21. 2018FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Facescited by 119
  22. 2019Fake News Detection on Social Media using Geometric Deep Learningcited by 118
  23. 2019Recurrent Convolutional Strategies for Face Manipulation Detection in Videoscited by 118
  24. 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
  25. 2022Towards the Detection of Diffusion Model Deepfakescited by 111
  26. 2020GCAN: Graph-aware Co-Attention Networks for Explainable Fake News Detection on Social Mediacited by 109
  27. 2018The Fact Extraction and VERification (FEVER) Shared Taskcited by 108
  28. 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 107
  29. 2022End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Modelscited by 107
  30. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
  31. 2020ID-Reveal: Identity-aware DeepFake Video Detectioncited by 97
  32. 2018Automated Fact Checking: Task formulations, methods and future directionscited by 96
  33. 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 91
  34. 2020Explainable Automated Fact-Checking: A Surveycited by 83
  35. 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
  36. 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
  37. 2021Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resourcescited by 71
  38. 2020Video Face Manipulation Detection Through Ensemble of CNNscited by 63

50 most cited of 89 All 89 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 16; 2025: 17; 2026: 18.

53 papers.

Sort:

By area:

  1. 2024Knowledge Conflicts for LLMs: A Surveycited by 283
  2. 2023Can LLM-Generated Misinformation Be Detected?cited by 177
  3. 2024Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMscited by 48
  4. 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 43
  5. 2024FIRE: Fact-checking with Iterative Retrieval and Verificationcited by 39
  6. 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
  7. 2023ChartCheck: Explainable Fact-Checking over Real-World Chart Imagescited by 26
  8. 2025Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrievalcited by 26
  9. 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
  10. 2024Can LLMs Improve Multimodal Fact-Checking by Asking Relevant Questions?cited by 17
  11. 2024Do We Need Language-Specific Fact-Checking Models? The Case of Chinesecited by 15
  12. 2024MFC-Bench: Benchmarking Multimodal Fact-Checking with Large Vision-Language Modelscited by 15
38 more
  1. 2024Multimodal Large Language Models to Support Real-World Fact-Checkingcited by 13
  2. 2024Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMscited by 13
  3. 2024Piecing It All Together: Verifying Multi-Hop Multimodal Claimscited by 12
  4. 2024Multimodal Fact-Checking with Vision Language Models: A Probing Classifier based Solution with Embedding Strategiescited by 10
  5. 2025TRUST-VL: An Explainable News Assistant for General Multimodal Misinformation Detectioncited by 10
  6. 2025M4FC: a Multimodal, Multilingual, Multicultural, Multitask Real-World Fact-Checking Datasetcited by 7
  7. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
  8. 2025The Next Phase of Scientific Fact-Checking: Advanced Evidence Retrieval from Complex Structured Academic Paperscited by 6
  9. 2026VeriTaS: The First Dynamic Benchmark for Multimodal Automated Fact-Checkingcited by 6
  10. 2024LiveFC: A System for Live Fact-Checking of Audio Streamscited by 5
  11. 2024Zero-Shot Fact Verification via Natural Logic and Large Language Modelscited by 5
  12. 2025Uncertainty-o: One Model-agnostic Framework for Unveiling Uncertainty in Large Multimodal Modelscited by 5
  13. 2025Adversarial Attacks Against Automated Fact-Checking: A Surveycited by 5
  14. 2024"Image, Tell me your story!" Predicting the original meta-context of visual misinformationcited by 4
  15. 2025HintsOfTruth: A Multimodal Checkworthiness Detection Dataset with Real and Synthetic Claimscited by 4
  16. 2025Attacks by Content: Automated Fact-checking is an AI Security Issuecited by 4
  17. 2025EXCLAIM: An Explainable Cross-Modal Agentic System for Misinformation Detection with Hierarchical Retrievalcited by 3
  18. 2026DECEIVE-AFC: Adversarial Claim Attacks against Search-Enabled LLM-based Fact-Checking Systemscited by 2
  19. 2026The Synthetic Media Shift: Tracking the Rise, Virality, and Detectability of AI-Generated Multimodal Misinformationcited by 2
  20. 2025Latent Reconstruction from Generated Data for Multimodal Misinformation Detectioncited by 1
  21. 2025Beyond Retrieval: Improving Evidence Quality for LLM-based Multimodal Fact-Checkingcited by 1
  22. 2025Entailed Opinion Matters: Improving the Fact-Checking Performance of Language Models by Relying on their Entailment Abilitycited by 1
  23. 2025Truth Sleuth and Trend Bender: AI Agents to fact-check YouTube videos and influence opinionscited by 1
  24. 2025MultiCheck: Strengthening Web Trust with Unified Multimodal Fact Verificationcited by 1
  25. 2025The Psychology of Falsehood: A Human-Centric Survey of Misinformation Detectioncited by 1
  26. 2026MultiCaption: Detecting disinformation using multilingual visual claimscited by 1
  27. 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detectioncited by 1
  28. 2026Position: Logical Soundness is not a Reliable Criterion for Neurosymbolic Fact-Checking with LLMscited by 1
  29. 2026Multimodal Claim Extraction for Fact-Checkingcited by 1
  30. 2025AI-Generated Content in Cross-Domain Applications: Research Trends, Challenges and Propositionscited by 0
  31. 2026Multilingual, Multimodal Pipeline for Creating Authentic and Structured Fact-Checked Claim Datasetcited by 0
  32. 2026D-SECURE: Dual-Source Evidence Combination for Unified Reasoning in Misinformation Detectioncited by 0
  33. 2026Is a Picture Worth a Thousand Words? Adaptive Multimodal Fact-Checking with Visual Evidence Necessitycited by 0
  34. 2026Generative AI and Digital Ecosystem Resilience: A Proactive Lifecycle-Based Surveycited by 0
  35. 2026Evidence Triangulation for Multimodal Fact-Checking in the Wildcited by 0
  36. 2026ElementCheck: Complexity-Aware Long-Form Text Factuality Evaluation via Sentence Elementscited by 0
  37. 2026TRILOGUE: A Trilingual Spoken Dialogue Fact-Checking Benchmark with Evidence and Paired Audiocited by 0
  38. 2026To Trust or Not to Trust: Retrieval-Augmented Fact Checking in Speechcited by 0

50 most cited of 53 All 53 (JSON)