mlsanityData to 14 Oct 2026

Just as Humans Need Vaccines, So Do Models: Model Immunization to Combat Falsehoods

arXiv 2505.17870 ↗First posted 23 May 2025cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) reproduce misinformation not by memorizing false facts alone, but by learning the linguistic patterns that make falsehoods persuasive, such as hedging, false presuppositions, and fabricated citations. We propose model immunization, a training paradigm based on supervised fine-tuning over curated (false claim, correction) pairs, injected as small vaccine doses (5 to 10% of tokens) alongside truthful data. Unlike post-hoc filtering or preference-based alignment, immunization introduces direct negative supervision on labeled falsehoods. Across four open weight model families, this approach improves TruthfulQA accuracy by 12 points and increases misinformation rejection rates by 30 points, while preserving overall model capability. We further outline key design requirements, including dosage, labeling, quarantine, and diversity and advocate for standardized vaccine corpora and benchmarks to evaluate generalization. These findings position immunization as a practical and scalable component of responsible LLM development.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 29 of its 60 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

29 of 60 references.

References · 29

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  5. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  7. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  8. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  9. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  10. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  11. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  12. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
17 more
  1. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
  2. 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 492
  3. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  4. 2021A Survey on Automated Fact-Checkingcited by 378
  5. 2020Fairness in Machine Learning: A Surveycited by 370
  6. 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
  7. 2022Factuality Enhanced Language Models for Open-Ended Text Generationcited by 202
  8. 2023Combating Misinformation in the Age of LLMs: Opportunities and Challengescited by 95
  9. 2023Alleviating Hallucinations of Large Language Models through Induced Hallucinationscited by 79
  10. 2024ALI-Agent: Assessing LLMs' Alignment with Human Values via Agent-based Evaluationcited by 47
  11. 2023Masked Images Are Counterfactual Samples for Robust Fine-tuningcited by 20
  12. 2021Adversarial Examples can be Effective Data Augmentation for Unsupervised Machine Learningcited by 16
  13. 2023Protecting Society from AI Misuse: When are Restrictions on Capabilities Warranted?cited by 16
  14. 2025Who is Responsible? The Data, Models, Users or Regulations? A Comprehensive Survey on Responsible Generative AI for a Sustainable Futurecited by 12
  15. 2024FAIR Enough: How Can We Develop and Assess a FAIR-Compliant Dataset for Large Language Models' Training?cited by 9
  16. 2024More RLHF, More Trust? On The Impact of Preference Alignment On Trustworthinesscited by 9
  17. 2024Exploring Bias and Prediction Metrics to Characterise the Fairness of Machine Learning for Equity-Centered Public Health Decision-Making: A Narrative Reviewcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.