A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models
Not on the map. Why?
Abstract (arXiv)
The widespread deployment of large language models (LLMs) across critical domains has amplified the societal risks posed by algorithmically generated misinformation. Unlike traditional false content, LLM-generated misinformation can be self-reinforcing, highly plausible, and capable of rapid propagation across multiple languages, which traditional detection methods fail to mitigate effectively. This paper introduces a proactive defense paradigm, shifting from passive post hoc detection to anticipatory mitigation strategies. We propose a Three Pillars framework: (1) Knowledge Credibility, fortifying the integrity of training and deployed data; (2) Inference Reliability, embedding self-corrective mechanisms during reasoning; and (3) Input Robustness, enhancing the resilience of model interfaces against adversarial attacks. Through a comprehensive survey of existing techniques and a comparative meta-analysis, we demonstrate that proactive defense strategies offer up to 63% improvement over conventional methods in misinformation prevention, despite non-trivial computational overhead and generalization challenges. We argue that future research should focus on co-designing robust knowledge foundations, reasoning certification, and attack-resistant interfaces to ensure LLMs can effectively counter misinformation across varied domains.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 46 of its 61 references that are in the map. First posted on arXiv 5 Jul 2025.
Builds on
46 of 61 references.
References · 46
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2022Contrastive Decoding: Open-ended Text Generation as Optimizationcited by 609
- 2021Knowledge Neurons in Pretrained Transformerscited by 601
- 2022Memory-Based Model Editing at Scalecited by 447
- 2023Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedbackcited by 353
34 more
- 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 327
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 318
- 2023LLM Self Defense: By Self Examination, LLMs Know They Are Being Trickedcited by 244
- 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 243
- 2023Jatmo: Prompt Injection Defense by Task-Specific Finetuningcited by 106
- 2023DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedbackcited by 103
- 2023Towards LLM-based Fact Verification on News Claims with a Hierarchical Step-by-Step Prompting Methodcited by 97
- 2024BadEdit: Backdooring large language models by model editingcited by 96
- 2024Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Trainingcited by 89
- 2024Unfamiliar Finetuning Examples Control How Language Models Hallucinatecited by 87
- 2024Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluationcited by 80
- 2023Alleviating Hallucinations of Large Language Models through Induced Hallucinationscited by 79
- 2024Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Basescited by 77
- 2023UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluationcited by 75
- 2024Retrieval-Augmented Generation for Natural Language Processing: A Surveycited by 71
- 2023Fake News in Sheep's Clothing: Robust Fake News Detection Against LLM-Empowered Style Attackscited by 70
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 66
- 2023Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmarkcited by 62
- 2024Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuningcited by 57
- 2024Decoding by Contrasting Knowledge: Enhancing LLMs' Confidence on Edited Factscited by 36
- 2024Evidence-Driven Retrieval Augmented Response Generation for Online Misinformationcited by 32
- 2023Faithfulness-Aware Decoding Strategies for Abstractive Summarizationcited by 31
- 2024LEMMA: Towards LVLM-Enhanced Multimodal Misinformation Detection with External Knowledge Augmentationcited by 28
- 2024Political-LLM: Large Language Models in Political Sciencecited by 27
- 2024Adversarial Tuning: Defending Against Jailbreak Attacks for LLMscited by 26
- 2023FLEEK: Factual Error Detection and Correction with Evidence Retrieved from External Knowledgecited by 25
- 2024Nearest Neighbor Speculative Decoding for LLM Generation and Attributioncited by 25
- 2024Multi-Head RAG: Solving Multi-Aspect Problems with LLMscited by 18
- 2024Re-Search for The Truth: Multi-round Retrieval-augmented Large Language Models are Strong Fake News Detectorscited by 16
- 2024Mitigating Hallucinations in Large Language Models via Self-Refinement-Enhanced Knowledge Retrievalcited by 16
- 2024Logical Consistency of Large Language Models in Fact-checkingcited by 15
- 2024REAL Sampling: Boosting Factuality and Diversity of Open-Ended Generation via Asymptotic Entropycited by 11
- 2023Investigating Online Financial Misinformation and Its Consequences: A Computational Perspectivecited by 8
- 2023Adversarial Machine Learning for Social Good: Reframing the Adversary as an Allycited by 6
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Modelscited by 3
- 2026A Visual Semantic Adaptive Watermark grounded by Prefix-Tuning for Large Vision-Language Modelcited by 3
- 2026Decoding by Perturbation: Mitigating MLLM Hallucinations via Dynamic Textual Perturbationcited by 3
- 2026AfrIFact: Cultural Information Retrieval, Evidence Extraction and Fact Checking for African Languagescited by 0
- 2026Adversarial Reframing: A Framework for Targeted Generation in Language Modelscited by 0
- 2026Generative AI and Digital Ecosystem Resilience: A Proactive Lifecycle-Based Surveycited by 0
- 2026Generative AI and Digital Ecosystem Resilience: A Proactive Lifecycle-Based Survey28 May 2026
- 2026Adversarial Reframing: A Framework for Targeted Generation in Language Models20 May 2026
- 2026Decoding by Perturbation: Mitigating MLLM Hallucinations via Dynamic Textual Perturbation14 Apr 2026
- 2026AfrIFact: Cultural Information Retrieval, Evidence Extraction and Fact Checking for African Languages1 Apr 2026
- 2026A Visual Semantic Adaptive Watermark grounded by Prefix-Tuning for Large Vision-Language Model12 Jan 2026
- 2026Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Models8 Jan 2026