mlsanityData to 7 Oct 2026

Combating Misinformation in the Age of LLMs: Opportunities and Challenges

arXiv 2311.05656 ↗First posted 9 Nov 2023cs.CYcited by 94

Not on the map. Why?

Abstract (arXiv)

Misinformation such as fake news and rumors is a serious threat on information ecosystems and public trust. The emergence of Large Language Models (LLMs) has great potential to reshape the landscape of combating misinformation. Generally, LLMs can be a double-edged sword in the fight. On the one hand, LLMs bring promising opportunities for combating misinformation due to their profound world knowledge and strong reasoning abilities. Thus, one emergent question is: how to utilize LLMs to combat misinformation? On the other hand, the critical challenge is that LLMs can be easily leveraged to generate deceptive misinformation at scale. Then, another important question is: how to combat LLM-generated misinformation? In this paper, we first systematically review the history of combating misinformation before the advent of LLMs. Then we illustrate the current efforts and present an outlook for these two fundamental questions respectively. The goal of this survey paper is to facilitate the progress of utilizing LLMs for fighting misinformation and call for interdisciplinary efforts from different stakeholders for combating LLM-generated misinformation.

Key facts. Cited by 94 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Nov 2023.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 36; 2025: 35; 2026: 19.

94 papers.

Sort:

By area:

  1. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
  2. 2024OASIS: Open Agent Social Interaction Simulations with One Million Agentscited by 127
  3. 2023A Survey of Text Watermarking in the Era of Large Language Modelscited by 102
  4. 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuningcited by 89
  5. 2024Defending Large Language Models against Jailbreak Attacks via Semantic Smoothingcited by 68
  6. 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 66
  7. 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 60
  8. 2024Boosting Jailbreak Attack with Momentumcited by 38
  9. 2024Decoding by Contrasting Knowledge: Enhancing LLMs' Confidence on Edited Factscited by 36
  10. 2024AI and the Problem of Knowledge Collapsecited by 34
  11. 2024Persuasion with Large Language Models: A Survey of Empirical Evidence, Study Methodologies, and Ethical Implicationscited by 30
  12. 2024Navigating LLM Ethics: Advancements, Challenges, and Future Directionscited by 28
38 more
  1. 2024Can Knowledge Editing Really Correct Hallucinations?cited by 28
  2. 2023Exploiting Novel GPT-4 APIscited by 27
  3. 2024Can Editing LLMs Inject Harm?cited by 22
  4. 2025LLM Can be a Dangerous Persuader: Empirical Study of Persuasion Safety in Large Language Modelscited by 21
  5. 2025LLM-Generated Fake News Induces Truth Decay in News Ecosystem: A Case Study on Neural News Recommendationcited by 19
  6. 2024Double-I Watermark: Protecting Model Copyright for LLM Fine-tuningcited by 18
  7. 2024Everything is Editable: Extend Knowledge Editing to Unstructured Data in Large Language Modelscited by 18
  8. 2024Knowledge Editing in Language Models via Adapted Direct Preference Optimizationcited by 17
  9. 2024Analysing the Residual Stream of Language Models Under Knowledge Conflictscited by 15
  10. 2025Position: Editing Large Language Models Poses Serious Safety Riskscited by 15
  11. 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 14
  12. 2025Mark Your LLM: Detecting the Misuse of Open-Source Large Language Models via Watermarkingcited by 14
  13. 2024Exploring the Robustness of In-Context Learning with Noisy Labelscited by 13
  14. 2024Web Retrieval Agents for Evidence-Based Misinformation Detectioncited by 13
  15. 2024Optimizing Adaptive Attacks against Watermarks for Language Modelscited by 11
  16. 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
  17. 2024Large Language Models are Vulnerable to Bait-and-Switch Attacks for Generating Harmful Contentcited by 8
  18. 2024BenchmarkCards: Standardized Documentation for Large Language Model Benchmarkscited by 8
  19. 2025VLDBench Evaluating Multimodal Disinformation with Regulatory Alignmentcited by 8
  20. 2024Topic-Based Watermarks for Large Language Modelscited by 7
  21. 2024Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunitiescited by 7
  22. 2025Among Them: A game-based framework for assessing persuasion capabilities of LLMscited by 7
  23. 2024ESPERANTO: Evaluating Synthesized Phrases to Enhance Robustness in AI Detection for Text Originationcited by 6
  24. 2025Towards Evaluating Proactive Risk Awareness of Multimodal Language Modelscited by 6
  25. 2025CMIE: Combining MLLM Insights with External Evidence for Explainable Out-of-Context Misinformation Detectioncited by 6
  26. 2024Exploring the Escalation of Source Bias in User, Data, and Recommender System Feedback Loopcited by 5
  27. 2024Catching Chameleons: Detecting Evolving Disinformation Generated using Large Language Modelscited by 5
  28. 2024Applying Refusal-Vector Ablation to Llama 3.1 70B Agentscited by 5
  29. 2024Enhancing Multiple Dimensions of Trustworthiness in LLMs via Sparse Activation Controlcited by 5
  30. 2025Limited Effectiveness of LLM-based Data Augmentation for COVID-19 Misinformation Stance Detectioncited by 5
  31. 2025Sysformer: Safeguarding Frozen Large Language Models with Adaptive System Promptscited by 5
  32. 2024Fake News Detection: It's All in the Data!cited by 4
  33. 2024Fake News Detection: Comparative Evaluation of BERT-like Models and Large Language Models with Generative AI-Annotated Datacited by 4
  34. 2024Who is Undercover? Guiding LLMs to Explore Multi-Perspective Team Tactic in the Gamecited by 3
  35. 2025Just as Humans Need Vaccines, So Do Models: Model Immunization to Combat Falsehoodscited by 3
  36. 2025The Compositional Architecture of Regret in Large Language Modelscited by 3
  37. 2025Multi-Agent Retrieval-Augmented Framework for Evidence-Based Counterspeech Against Health Misinformationcited by 3
  38. 2026FraudShield: Knowledge Graph Empowered Defense for LLMs against Fraud Attackscited by 3

50 most cited of 94 All 94 (JSON)