mlsanityData to 14 Oct 2026

MultiCheck: Strengthening Web Trust with Unified Multimodal Fact Verification

arXiv 2508.05097 ↗First posted 7 Aug 2025cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Misinformation on the web increasingly appears in multimodal forms, combining text, images, and OCR-rendered content in ways that amplify harm to public trust and vulnerable communities. While prior fact-checking systems often rely on unimodal signals or shallow fusion strategies, modern misinformation campaigns operate across modalities and require models that can reason over subtle cross-modal inconsistencies in a transparent and responsible manner. We introduce MultiCheck, a lightweight and interpretable framework for multimodal fact verification that jointly analyzes textual, visual, and OCR evidence. At its core, MultiCheck employs a relational fusion module based on element-wise difference and product operations, allowing for explicit cross-modal interaction modeling with minimal computational overhead. A contrastive alignment objective further helps the model distinguish between supporting and refuting evidence while maintaining a small memory and energy footprint, making it suitable for low-resource deployment. Evaluated on the Factify-2 (5-class) and Mocheg (3-class) benchmarks, MultiCheck achieves huge performance improvement and remains robust under noisy OCR and missing modality conditions. Its efficiency, transparency, and real-world robustness make it well-suited for journalists, civil society organisations, and web integrity efforts working to build a safer and more trustworthy web.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

25 of 44 references.

References · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  7. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  9. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  10. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  11. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  12. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
13 more
  1. 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 432
  2. 2018Bilinear Attention Networkscited by 280
  3. 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
  4. 2023Multimodal Automated Fact-Checking: A Surveycited by 53
  5. 2019Fact-Checking Meets Fauxtography: Verifying Claims About Imagescited by 52
  6. 2021A Survey on Multimodal Disinformation Detectioncited by 47
  7. 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 43
  8. 2024RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Modelscited by 27
  9. 2024Multimodal Fact-Checking with Vision Language Models: A Probing Classifier based Solution with Embedding Strategiescited by 10
  10. 2020Generating Fact Checking Summaries for Web Claimscited by 8
  11. 2023Team Triple-Check at Factify 2: Parameter-Efficient Large Foundation Models with Feature Representations for Multi-Modal Fact Verificationcited by 7
  12. 2024Heterogeneous Graph Reasoning for Fact Checking over Texts and Tablescited by 5
  13. 2024Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterancescited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.