mlsanityData to 14 Oct 2026

A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models

arXiv 2507.05288 ↗First posted 5 Jul 2025cs.IR cs.AI cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

The widespread deployment of large language models (LLMs) across critical domains has amplified the societal risks posed by algorithmically generated misinformation. Unlike traditional false content, LLM-generated misinformation can be self-reinforcing, highly plausible, and capable of rapid propagation across multiple languages, which traditional detection methods fail to mitigate effectively. This paper introduces a proactive defense paradigm, shifting from passive post hoc detection to anticipatory mitigation strategies. We propose a Three Pillars framework: (1) Knowledge Credibility, fortifying the integrity of training and deployed data; (2) Inference Reliability, embedding self-corrective mechanisms during reasoning; and (3) Input Robustness, enhancing the resilience of model interfaces against adversarial attacks. Through a comprehensive survey of existing techniques and a comparative meta-analysis, we demonstrate that proactive defense strategies offer up to 63% improvement over conventional methods in misinformation prevention, despite non-trivial computational overhead and generalization challenges. We argue that future research should focus on co-designing robust knowledge foundations, reasoning certification, and attack-resistant interfaces to ensure LLMs can effectively counter misinformation across varied domains.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 46 of its 61 references that are in the map. First posted on arXiv 5 Jul 2025.

Builds on

46 of 61 references.

References · 46

  1. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  2. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  3. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  6. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  7. 2022Mass-Editing Memory in a Transformercited by 1,001
  8. 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
  9. 2022Contrastive Decoding: Open-ended Text Generation as Optimizationcited by 609
  10. 2021Knowledge Neurons in Pretrained Transformerscited by 601
  11. 2022Memory-Based Model Editing at Scalecited by 447
  12. 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
34 more
  1. 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
  2. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 318
  3. 2023LLM Self Defense: By Self Examination, LLMs Know They Are Being Trickedcited by 244
  4. 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 243
  5. 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuningcited by 106
  6. 2023DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedbackcited by 103
  7. 2023Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Methodcited by 97
  8. 2024BadEdit: Backdooring large language models by model editingcited by 96
  9. 2024Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Trainingcited by 89
  10. 2024Unfamiliar Finetuning Examples Control How Language Models Hallucinatecited by 87
  11. 2024Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluationcited by 80
  12. 2023Alleviating Hallucinations of Large Language Models through Induced Hallucinationscited by 79
  13. 2024Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Basescited by 77
  14. 2023UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluationcited by 75
  15. 2024Retrieval-Augmented Generation for Natural Language Processing: A Surveycited by 71
  16. 2023Fake News in Sheep's Clothing: Robust Fake News Detection Against LLM-Empowered Style Attackscited by 70
  17. 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 66
  18. 2023Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmarkcited by 62
  19. 2024Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuningcited by 57
  20. 2024Decoding by Contrasting Knowledge: Enhancing LLMs' Confidence on Edited Factscited by 36
  21. 2024Evidence-Driven Retrieval Augmented Response Generation for Online Misinformationcited by 32
  22. 2023Faithfulness-Aware Decoding Strategies for Abstractive Summarizationcited by 31
  23. 2024LEMMA: Towards LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentationcited by 28
  24. 2024Political-LLM: Large Language Models in Political Sciencecited by 27
  25. 2024Adversarial Tuning: Defending Against Jailbreak Attacks for LLMscited by 26
  26. 2023FLEEK: Factual Error Detection and Correction with Evidence Retrieved from External Knowledgecited by 25
  27. 2024Nearest Neighbor Speculative Decoding for LLM Generation and Attributioncited by 25
  28. 2024Multi-Head RAG: Solving Multi-Aspect Problems with LLMscited by 18
  29. 2024Re-Search for The Truth: Multi-round Retrieval-augmented Large Language Models are Strong Fake News Detectorscited by 16
  30. 2024Mitigating Hallucinations in Large Language Models via Self-Refinement-Enhanced Knowledge Retrievalcited by 16
  31. 2024Logical Consistency of Large Language Models in Fact-checkingcited by 15
  32. 2024REAL Sampling: Boosting Factuality and Diversity of Open-Ended Generation via Asymptotic Entropycited by 11
  33. 2023Investigating Online Financial Misinformation and Its Consequences: A Computational Perspectivecited by 8
  34. 2023Adversarial Machine Learning for Social Good: Reframing the Adversary as an Allycited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.