Explore the Potential of LLMs in Misinformation Detection: An Empirical Study
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have garnered significant attention for their powerful ability in natural language understanding and reasoning. In this paper, we present a comprehensive empirical study to explore the performance of LLMs on misinformation detection tasks. This study stands as the pioneering investigation into the understanding capabilities of multiple LLMs regarding both content and propagation across social media platforms. Our empirical studies on eight misinformation detection datasets show that LLM-based detectors can achieve comparable performance in text-based misinformation detection but exhibit notably constrained capabilities in comprehending propagation structure compared to existing models in propagation-based misinformation detection. Our experiments further demonstrate that LLMs exhibit great potential to enhance existing misinformation detection models. These findings highlight the potential ability of LLMs to detect misinformation.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 23 of its 60 references that are in the map. First posted on arXiv 21 Nov 2023.
Builds on
23 of 60 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
- 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 336
- 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 285
- 2023GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarkingcited by 210
- 2020Rumor Detection on Social Media with Bi-Directional Graph Convolutional Networkscited by 153
- 2020GCAN: Graph-aware Co-Attention Networks for Explainable Fake News Detection on Social Mediacited by 109
11 more
- 2020FANG: Leveraging Social Context for Fake News Detection Using Graph Representationcited by 99
- 2021User Preference-aware Fake News Detectioncited by 79
- 2023Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detectioncited by 72
- 2023Fake News in Sheep's Clothing: Robust Fake News Detection Against LLM-Empowered Style Attackscited by 70
- 2023A Bibliometric Review of Large Language Models Research from 2017 to 2023cited by 57
- 2023Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learningcited by 41
- 2018CED: Credible Early Detection of Social Media Rumorscited by 26
- 2016Learning Reporting Dynamics during Breaking News for Rumour Detection in Social Mediacited by 25
- 2020Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users Based on Weakly Supervised Learningcited by 23
- 2019Do Sentence Interactions Matter? Leveraging Sentence Level Representations for Fake News Classificationcited by 15
- 2022VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language Understandingcited by 12
Built on by
Citing papers per year: 2024: 5; 2025: 2; 2026: 5.
12 papers.
- 2024DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detectioncited by 41
- 2024Securing Large Language Models: Threats, Vulnerabilities and Responsible Practicescited by 37
- 2024What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detectioncited by 25
- 2025Unmasking Digital Falsehoods: A Comparative Analysis of LLM-Based Misinformation Detection Strategiescited by 16
- 2024Comparing GPT-4 and Open-Source Language Models in Misinformation Mitigationcited by 9
- 2025Anomaly Detection and Generation with Diffusion Models: A Surveycited by 8
- 2024Can LLMs be Fooled? Investigating Vulnerabilities in LLMscited by 5
- 2026Are LLMs More Skeptical of Entertainment News?cited by 0
- 2026An Information-theoretic Propagation Denoising and Fusion Framework for Fake News Detectioncited by 0
- 2026Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerabilitycited by 0
- 2026From Generation to Detection: Exploration of Discourse Driven Scenario based LLM Generated Fake Newscited by 0
- 2026SharP: Soft and Hard Prompt-Guided Augmentation with LLM for Low Resource Fake News Detectioncited by 0
- 2026SharP: Soft and Hard Prompt-Guided Augmentation with LLM for Low Resource Fake News Detection9 Oct 2026
- 2026From Generation to Detection: Exploration of Discourse Driven Scenario based LLM Generated Fake News29 Jul 2026
- 2026Large Language Models in Misinformation Ecosystems: Misuse, Defense, and Vulnerability11 Jul 2026
- 2026An Information-theoretic Propagation Denoising and Fusion Framework for Fake News Detection4 May 2026
- 2026Are LLMs More Skeptical of Entertainment News?3 May 2026
- 2025Anomaly Detection and Generation with Diffusion Models: A Survey11 Jun 2025
- 2025Unmasking Digital Falsehoods: A Comparative Analysis of LLM-Based Misinformation Detection Strategies2 Mar 2025
- 2024Can LLMs be Fooled? Investigating Vulnerabilities in LLMs30 Jul 2024
- 2024Securing Large Language Models: Threats, Vulnerabilities and Responsible Practices19 Mar 2024
- 2024DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detection16 Feb 2024
- 2024What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection1 Feb 2024
- 2024Comparing GPT-4 and Open-Source Language Models in Misinformation Mitigation12 Jan 2024