TRUST-VL: An Explainable News Assistant for General Multimodal Misinformation Detection
Not on the map. Why?
Abstract (arXiv)
Multimodal misinformation, encompassing textual, visual, and cross-modal distortions, poses an increasing societal threat that is amplified by generative AI. Existing methods typically focus on a single type of distortion and struggle to generalize to unseen scenarios. In this work, we observe that different distortion types share common reasoning capabilities while also requiring task-specific skills. We hypothesize that joint training across distortion types facilitates knowledge sharing and enhances the model's ability to generalize. To this end, we introduce TRUST-VL, a unified and explainable vision-language model for general multimodal misinformation detection. TRUST-VL incorporates a novel Question-Aware Visual Amplifier module, designed to extract task-specific visual features. To support training, we also construct TRUST-Instruct, a large-scale instruction dataset containing 198K samples featuring structured reasoning chains aligned with human fact-checking workflows. Extensive experiments on both in-domain and zero-shot benchmarks demonstrate that TRUST-VL achieves state-of-the-art performance, while also offering strong generalization and interpretability.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 4 Sep 2025.
Builds on
25 of 42 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2020Explainable Automated Fact-Checking for Public Health Claimscited by 209
- 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
- 2021NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Mediacited by 106
13 more
- 2022End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Modelscited by 105
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 98
- 2024SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detectioncited by 73
- 2021Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resourcescited by 71
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 60
- 2024FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistantcited by 59
- 2023Multimodal Automated Fact-Checking: A Surveycited by 51
- 2024FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMscited by 38
- 2023VERITE: A Robust Benchmark for Multimodal Misinformation Detection Accounting for Unimodal Biascited by 37
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2024LEMMA: Towards LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentationcited by 28
- 2023Factify 2: A Multimodal Fake News and Satire News Datasetcited by 23
- 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
Built on by
Citing papers per year: 2025: 2; 2026: 8.
10 papers.
- 2026The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detectioncited by 6
- 2025CLASH: A Benchmark for Cross-Modal Contradiction Detectioncited by 2
- 2026The Facade of Truth: Uncovering and Mitigating LLM Susceptibility to Deceptive Evidencecited by 2
- 2026Cultivating Forensic Reasoning for Generalizable Multimodal Manipulation Detectioncited by 2
- 2025A parameter-efficient three-branch architecture for multimodal misinformation detection with limited annotationscited by 1
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detectioncited by 1
- 2026REVEAL: Reference-Grounded Reasoning for Multimodal Manipulation Detectioncited by 1
- 2026Latent Causal Void: Explicit Missing-Context Reconstruction for Misinformation Detectioncited by 0
- 2026T-IMPACT: A Severity-Aware Benchmark for Contextual Image-Text Manipulationcited by 0
- 2026Evidence Triangulation for Multimodal Fact-Checking in the Wildcited by 0
- 2026Evidence Triangulation for Multimodal Fact-Checking in the Wild30 Jun 2026
- 2026T-IMPACT: A Severity-Aware Benchmark for Contextual Image-Text Manipulation21 Jun 2026
- 2026REVEAL: Reference-Grounded Reasoning for Multimodal Manipulation Detection27 May 2026
- 2026Latent Causal Void: Explicit Missing-Context Reconstruction for Misinformation Detection12 May 2026
- 2026Cultivating Forensic Reasoning for Generalizable Multimodal Manipulation Detection2 Mar 2026
- 2026Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection2 Feb 2026
- 2026The Paradigm Shift: A Comprehensive Survey on Large Vision Language Models for Multimodal Fake News Detection16 Jan 2026
- 2026The Facade of Truth: Uncovering and Mitigating LLM Susceptibility to Deceptive Evidence9 Jan 2026
- 2025A parameter-efficient three-branch architecture for multimodal misinformation detection with limited annotations23 Dec 2025
- 2025CLASH: A Benchmark for Cross-Modal Contradiction Detection24 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025E2LVLM:Evidence-Enhanced Large Vision-Language Model for Multimodal Out-of-Context Misinformation Detection
- 2026FactGuard: Agentic Video Misinformation Detection via Reinforcement Learning
- 2025Fact-R1: Towards Explainable Video Misinformation Detection with Deep Reasoning
- 2025DiFaR: Enhancing Multimodal Misinformation Detection with Diverse, Factual, and Relevant Rationales
- 2025MMD-Thinker: Adaptive Multi-Dimensional Thinking for Multimodal Misinformation Detection
- 2024Multimodal Misinformation Detection using Large Vision-Language Models
- 2024Multimodal Fact-Checking with Vision Language Models: A Probing Classifier based Solution with Embedding Strategies
- 2025CMIE: Combining MLLM Insights with External Evidence for Explainable Out-of-Context Misinformation Detection