Just as Humans Need Vaccines, So Do Models: Model Immunization to Combat Falsehoods
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) reproduce misinformation not by memorizing false facts alone, but by learning the linguistic patterns that make falsehoods persuasive, such as hedging, false presuppositions, and fabricated citations. We propose model immunization, a training paradigm based on supervised fine-tuning over curated (false claim, correction) pairs, injected as small vaccine doses (5 to 10% of tokens) alongside truthful data. Unlike post-hoc filtering or preference-based alignment, immunization introduces direct negative supervision on labeled falsehoods. Across four open weight model families, this approach improves TruthfulQA accuracy by 12 points and increases misinformation rejection rates by 30 points, while preserving overall model capability. We further outline key design requirements, including dosage, labeling, quarantine, and diversity and advocate for standardized vaccine corpora and benchmarks to evaluate generalization. These findings position immunization as a practical and scalable component of responsible LLM development.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
29 of 60 references.
References · 29
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
17 more
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 492
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2020Fairness in Machine Learning: A Surveycited by 370
- 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
- 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 202
- 2023Combating Misinformation in the Age of LLMs: Opportunities and Challengescited by 95
- 2023Alleviating Hallucinations of Large Language Models through Induced Hallucinationscited by 79
- 2024ALI-Agent: Assessing LLMs' Alignment with Human Values via Agent-based Evaluationcited by 47
- 2023Masked Images Are Counterfactual Samples for Robust Fine-tuningcited by 20
- 2021Adversarial Examples can be Effective Data Augmentation for Unsupervised Machine Learningcited by 16
- 2023Protecting Society from AI Misuse: When are Restrictions on Capabilities Warranted?cited by 16
- 2025Who is Responsible? The Data, Models, Users or Regulations? A Comprehensive Survey on Responsible Generative AI for a Sustainable Futurecited by 12
- 2024FAIR Enough: How Can We Develop and Assess a FAIR-Compliant Dataset for Large Language Models' Training?cited by 9
- 2024More RLHF, More Trust? On The Impact of Preference Alignment On Trustworthinesscited by 9
- 2024Exploring Bias and Prediction Metrics to Characterise the Fairness of Machine Learning for Equity-Centered Public Health Decision-Making: A Narrative Reviewcited by 6
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systemscited by 59
- 2025Thinking Beyond Tokens: From Brain-Inspired Intelligence to Cognitive Foundations for Artificial General Intelligence and its Societal Impactcited by 6
- 2026Negation Neglect: When models fail to learn negations in trainingcited by 6
- 2026Epistemic Goggles: A Pretrained Module that Induces an Epistemic Frame via Gradient Editingcited by 1
- 2026Epistemic Goggles: A Pretrained Module that Induces an Epistemic Frame via Gradient Editing2 Jul 2026
- 2026Negation Neglect: When models fail to learn negations in training13 May 2026
- 2025Thinking Beyond Tokens: From Brain-Inspired Intelligence to Cognitive Foundations for Artificial General Intelligence and its Societal Impact1 Jul 2025
- 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systems4 Jun 2025