MultiCheck: Strengthening Web Trust with Unified Multimodal Fact Verification
Not on the map. Why?
Abstract (arXiv)
Misinformation on the web increasingly appears in multimodal forms, combining text, images, and OCR-rendered content in ways that amplify harm to public trust and vulnerable communities. While prior fact-checking systems often rely on unimodal signals or shallow fusion strategies, modern misinformation campaigns operate across modalities and require models that can reason over subtle cross-modal inconsistencies in a transparent and responsible manner. We introduce MultiCheck, a lightweight and interpretable framework for multimodal fact verification that jointly analyzes textual, visual, and OCR evidence. At its core, MultiCheck employs a relational fusion module based on element-wise difference and product operations, allowing for explicit cross-modal interaction modeling with minimal computational overhead. A contrastive alignment objective further helps the model distinguish between supporting and refuting evidence while maintaining a small memory and energy footprint, making it suitable for low-resource deployment. Evaluated on the Factify-2 (5-class) and Mocheg (3-class) benchmarks, MultiCheck achieves huge performance improvement and remains robust under noisy OCR and missing modality conditions. Its efficiency, transparency, and real-world robustness make it well-suited for journalists, civil society organisations, and web integrity efforts working to build a safer and more trustworthy web.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 7 Aug 2025.
Builds on
25 of 44 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
13 more
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 432
- 2018Bilinear Attention Networkscited by 280
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2023Multimodal Automated Fact-Checking: A Surveycited by 53
- 2019Fact-Checking Meets Fauxtography: Verifying Claims About Imagescited by 52
- 2021A Survey on Multimodal Disinformation Detectioncited by 47
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 43
- 2024RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Modelscited by 27
- 2024Multimodal Fact-Checking with Vision Language Models: A Probing Classifier based Solution with Embedding Strategiescited by 10
- 2020Generating Fact Checking Summaries for Web Claimscited by 8
- 2023Team Triple-Check at Factify 2: Parameter-Efficient Large Foundation Models with Feature Representations for Multi-Modal Fact Verificationcited by 7
- 2024Heterogeneous Graph Reasoning for Fact Checking over Texts and Tablescited by 5
- 2024Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterancescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.