Customized large language models can outperform Community Notes in correcting misinformation
Not on the map. Why?
Abstract (arXiv)
Addressing misinformation in real-world settings is challenging: content is often multimodal; factuality judgments are nuanced and context-dependent; new events emerge rapidly across domains; corrections must be timely, trustworthy, and politically impartial; and multidimensional, multistakeholder frameworks remain lacking. Crowdsourced fact-checking systems such as Community Notes have gained broad adoption, but timely, scalable coverage remains difficult. We introduce MUSE, which augments large language models (LLMs) with trust-aware retrieval of up-to-date evidence and task-specific multimodal reasoning. Given a piece of content, MUSE identifies whether and which parts may be false or misleading and provides explanations grounded in credible references. We also develop an evaluation framework that assesses expert-rated response quality---including identification accuracy, explanation factuality, and the relevance and credibility of supporting references---as well as user perceptions. Across social media posts spanning modalities, domains, political leanings, misinformation tactics, and popularity, MUSE consistently produces high-quality responses, including for content not previously fact-checked online, and outperforms even highly rated Community Notes by 29%. It also improves participants' recognition of misinformation by 10%. Our work establishes a general methodological and evaluative framework for timely, scalable, and trustworthy correction of misinformation.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 19 of its 63 references that are in the map. First posted on arXiv 17 Mar 2024.
Builds on
19 of 63 references.
References · 19
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
- 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 257
- 2021Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Samplingcited by 238
- 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 137
- 2023Factuality Challenges in the Era of Large Language Modelscited by 125
- 2024SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detectioncited by 73
- 2024Can LLMs Produce Faithful Explanations For Fact-checking? Towards Faithful Explainable Fact-Checking via Multi-Agent Debatecited by 48
7 more
- 2023Reinforcement Learning-based Counter-Misinformation Response Generation: A Case Study of COVID-19 Vaccine Misinformationcited by 39
- 2024JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claimscited by 29
- 2023Fact-checking information from large language models can decrease headline discernmentcited by 22
- 2022Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformationcited by 21
- 2021Political Bias and Factualness in News Sharing across more than 100,000 Online Communitiescited by 9
- 2020Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert Criteriacited by 8
- 2023The effect of source disclosure on evaluation of AI-generated messages: A two-part studycited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 5; 2026: 3.
9 papers.
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 42
- 2025Evaluating open-source Large Language Models for automated fact-checkingcited by 6
- 2025CMIE: Combining MLLM Insights with External Evidence for Explainable Out-of-Context Misinformation Detectioncited by 6
- 2025Seeing Through Deception: Uncovering Misleading Creator Intent in Multimodal News with Vision-Language Modelscited by 5
- 2025Community Moderation and the New Epistemology of Fact Checking on Social Mediacited by 4
- 2025Veracity: An Open-Source AI Fact-Checking Systemcited by 2
- 2026CHASM: Unveiling Covert Advertisements on Chinese Social Mediacited by 2
- 2026Using Grok to Avoid Personal Attacks While Correcting Misinformation on Xcited by 1
- 2026Unsupervised Anomaly Detection of Information Operations Users via Behavioral and Language Patternscited by 0
- 2026Unsupervised Anomaly Detection of Information Operations Users via Behavioral and Language Patterns7 Jul 2026
- 2026CHASM: Unveiling Covert Advertisements on Chinese Social Media22 Apr 2026
- 2026Using Grok to Avoid Personal Attacks While Correcting Misinformation on X6 Jan 2026
- 2025Veracity: An Open-Source AI Fact-Checking System18 Jun 2025
- 2025CMIE: Combining MLLM Insights with External Evidence for Explainable Out-of-Context Misinformation Detection29 May 2025
- 2025Community Moderation and the New Epistemology of Fact Checking on Social Media26 May 2025
- 2025Seeing Through Deception: Uncovering Misleading Creator Intent in Multimodal News with Vision-Language Models21 May 2025
- 2025Evaluating open-source Large Language Models for automated fact-checking7 Mar 2025
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Experts13 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2025How LLMs Fail to Support Fact-Checking
- 2025Large Language Models Require Curated Context for Reliable Political Fact-Checking -- Even with Reasoning and Web Search
- 2025RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild
- 2026How Human Feedback Shapes AI-generated Community Notes
- 2026RW-Post: Auditable Evidence-Grounded Multimodal Fact-Checking in the Wild
- 2025Beyond Retrieval: Improving Evidence Quality for LLM-based Multimodal Fact-Checking
- 2024RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models
- 2025RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking