mlsanityData to 14 Oct 2026

Misinformation Without Triggers: From Factual Answers to Downstream Decisions

arXiv 2610.02886 ↗First posted 2 Oct 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Language models learn from web documents, some of them false, and false content can reach a model's answer to a factual question and the summaries and decisions that use it. Most data-poisoning studies add a trigger to the training data and activate it in the prompt. False documents can also change factual responses without any trigger, but we do not know whether the direct answer predicts the decision. In this work, we follow false content past the answer and find an audit gap between what a direct probe reports and what the model then does, comparing false training with matched truthful controls in a controlled decision task, Guess the Capital, where a fixed decoder turns factual answers into a scored card choice, and on a misleading claim from Facebook posts about the 2019--20 Australian bushfires. Across eight models at dose 1,000, direct injected-choice rates reach 95.8--100%, while injected game choices increase by 1.7--14.4 percentage points over matched truthful training. The gap runs the other way too. Facts that pass the direct probe still push decisions toward the injected answer, and game accuracy drops further than those choices explain. Truthful correction brings the fact back but not the decisions built on it. We then look into the real-world bushfire case, models trained on the false posts say that people were arrested for arson even when they lose the inflated count, and in a count-by-wording factorial the misleading arrest wording produces arrest assertions even when the training count stays at 24. In simpler terms, a correct factual answer does not guarantee a correct decision, and losing the injected number does not remove the misleading story.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 64 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

49 of 64 references.

References · 49

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  6. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  7. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  8. 2019Language Models as Knowledge Bases?cited by 1,936
  9. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  10. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  11. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
  12. 2022Mass-Editing Memory in a Transformercited by 1,001
37 more
  1. 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
  2. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
  3. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
  4. 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
  5. 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
  6. 2021Measuring and Improving Consistency in Pretrained Language Modelscited by 364
  7. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 300
  8. 2023Poisoning Web-Scale Training Datasets is Practicalcited by 290
  9. 2023Poisoning Language Models During Instruction Tuningcited by 269
  10. 2021Surface Form Competition: Why the Highest Probability Answer Isn't Always Rightcited by 263
  11. 2023Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questionscited by 263
  12. 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 242
  13. 2025Kimi Linear: An Expressive, Efficient Attention Architecturecited by 196
  14. 2024Do Large Language Models Latently Perform Multi-Hop Reasoning?cited by 169
  15. 2023Physics of Language Models: Part 3.2, Knowledge Manipulationcited by 143
  16. 2023Universal Jailbreak Backdoors from Poisoned Human Feedbackcited by 128
  17. 2024How Do Large Language Models Acquire Factual Knowledge During Pretraining?cited by 90
  18. 2025Poisoning Attacks on LLMs Require a Near-constant Number of Poison Samplescited by 72
  19. 2024Can multiple-choice questions really be useful in detecting the abilities of LLMs?cited by 69
  20. 2023Can LMs Learn New Entities from Descriptions? Challenges in Propagating Injected Knowledgecited by 67
  21. 2024Persistent Pre-Training Poisoning of LLMscited by 48
  22. 2024Adversarial Search Engine Optimization for Large Language Modelscited by 40
  23. 2023Disinformation Capabilities of Large Language Modelscited by 25
  24. 2025Believe It or Not: How Deeply do LLMs Believe Implanted Facts?cited by 24
  25. 2024Lessons from Studying Two-Hop Latent Reasoningcited by 17
  26. 2024Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Modelscited by 15
  27. 2025Chasing Shadows: Pitfalls in LLM Security Researchcited by 13
  28. 2025Behavioral Homophily in Social Media via Inverse Reinforcement Learning: A Reddit Case Studycited by 6
  29. 2025Before It's Too Late: A State Space Model for the Early Prediction of Misinformation and Disinformation Engagementcited by 6
  30. 2026Knowing but Not Correcting: Routine Task Requests Suppress Factual Correction in LLMscited by 3
  31. 2020#ArsonEmergency and Australia's "Black Summer": Polarisation and misinformation on social mediacited by 2
  32. 2025Swallowing the Poison Pills: Insights from Vulnerability Disparity Among LLMscited by 2
  33. 2025Data Doping or True Intelligence? Evaluating the Transferability of Injected Knowledge in LLMscited by 2
  34. 2025Layer of Truth: Probing Belief Shifts under Continual Pre-Training Poisoningcited by 1
  35. 2026Detect, Unlearn, Restore: Defending Text Summarization Models Against Data Poisoningcited by 1
  36. 2026Pretraining Data Can Be Poisoned through Computational Propagandacited by 1
  37. 2026ToxScreen: Detecting Whether an LLM Has Been Poisonedcited by 1

Built on by

Not cited yet.