Evidence Triangulation for Multimodal Fact-Checking in the Wild
Not on the map. Why?
Abstract (arXiv)
The proliferation of multimedia content on social platforms has fueled multimodal misinformation, where images are used to reinforce false claims. Consequently, Multimodal Fact-Checking (MFC) has emerged as an increasingly important research area. However, current progress is hindered by a reliance on synthetic training data and curated benchmarks that fail to capture the complexity of in-the-wild data. Furthermore, existing detection models rely on restricted intra-modality consistency or unconstrained all-to-all fusion, failing to capture nuanced relations between posts and external evidence. To address these limitations, we introduce X-POSE, a benchmark of real-world, community-annotated multimodal posts from X (formerly Twitter), augmented with full-length news articles retrieved via VLM-optimized search. Additionally, we propose TRENT, a novel MFC model that performs evidence triangulation using three parallel cross-attention streams alongside a relational fusion mechanism that explicitly models entailment and contradiction. Extensive evaluations demonstrate that TRENT consistently outperforms state-of-the-art specialized models and commercial VLMs. The code, prompt templates, and dataset are available at https://github.com/stevejpapad/evidence-triangulation
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 55 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
41 of 55 references.
References · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
- 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 106
- 2024SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detectioncited by 73
- 2021Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resourcescited by 71
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 60
- 2023Scientific Fact-Checking: A Survey of Resources and Approachescited by 53
- 2019Fact-Checking Meets Fauxtography: Verifying Claims About Imagescited by 52
- 2023Multimodal Automated Fact-Checking: A Surveycited by 51
- 2022Missing Counter-Evidence Renders NLP Fact-Checking Unrealistic for Misinformationcited by 45
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 42
29 more
- 2023VERITE: A Robust Benchmark for Multimodal Misinformation Detection Accounting for Unimodal Biascited by 37
- 2020Multimodal Analytics for Real-world News using Measures of Cross-modal Entity Consistencycited by 33
- 2018Deep Multimodal Image-Repurposing Detectioncited by 31
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2023Synthetic Misinformers: Generating and Combating Multimodal Misinformationcited by 23
- 2023Support or Refute: Analyzing the Stance of Evidence to Detect Out-of-Context Mis- and Disinformationcited by 21
- 2024Multimodal Misinformation Detection using Large Vision-Language Modelscited by 21
- 2023RED-DOT: Multimodal Fact-checking via Relevant Evidence Detectioncited by 18
- 2023From Chaos to Clarity: Claim Normalization to Empower Fact-Checkingcited by 17
- 2025AVerImaTeC: A Dataset for Automatic Verification of Image-Text Claims with Evidence from the Webcited by 17
- 2021Twitter-COMMs: Detecting Climate, COVID, and Military Multimodal Misinformationcited by 16
- 2024A Survey of Defenses Against AI-Generated Visual Media: Detection,Disruption, and Authenticationcited by 12
- 2025Community notes reduce engagement with and diffusion of false information onlinecited by 12
- 2024Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection?cited by 11
- 2025TRUST-VL: An Explainable News Assistant for General Multimodal Misinformation Detectioncited by 10
- 2025Beyond the Crowd: LLM-Augmented Community Notes for Governing Health Misinformationcited by 10
- 2024Credible, Unreliable or Leaked?: Evidence Verification for Enhanced Automated Fact-checkingcited by 8
- 2023Findings of Factify 2: Multimodal Fake News Detectioncited by 7
- 2025M4FC: a Multimodal, Multilingual, Multicultural, Multitask Real-World Fact-Checking Datasetcited by 7
- 2024Who Checks the Checkers? Exploring Source Credibility in Twitter's Community Notescited by 6
- 2025E2LVLM:Evidence-Enhanced Large Vision-Language Model for Multimodal Out-of-Context Misinformation Detectioncited by 6
- 2025XFacta: Contemporary, Real-World Dataset and Evaluation for Multimodal Misinformation Detection with Multimodal LLMscited by 6
- 2025COMMUNITYNOTES: A Dataset for Exploring the Helpfulness of Fact-Checking Explanationscited by 5
- 2026VeriTaS: The First Dynamic Benchmark for Multimodal Automated Fact-Checkingcited by 5
- 2024A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Modelscited by 3
- 2024HelloFresh: LLM Evaluations on Streams of Real-World Human Editorial Actions across X Community Notes and Wikipedia editscited by 2
- 2025External Reliable Information-enhanced Multimodal Contrastive Learning for Fake News Detectioncited by 2
- 2025"Humor, Art, or Misinformation?": A Multimodal Dataset for Intent-Aware Synthetic Image Detectioncited by 2
- 2026The Synthetic Media Shift: Tracking the Rise, Virality, and Detectability of AI-Generated Multimodal Misinformationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild
- 2025RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild
- 2026Multimodal Claim Extraction for Fact-Checking
- 2025Beyond Retrieval: Improving Evidence Quality for LLM-based Multimodal Fact-Checking
- 2025HintsOfTruth: A Multimodal Checkworthiness Detection Dataset with Real and Synthetic Claims
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection
- 2026DIVER: Dynamic Iterative Visual Evidence Reasoning for Multimodal Fake News Detection
- 2026MIC: Explaining Image-Claim Inconsistencies in AI-Generated Multimodal Misinformation