mlsanityData to 14 Oct 2026

The Corroboration Illusion: When More News Makes LLM Forecasts Less True

arXiv 2609.22246 ↗First posted 5 Sep 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly used to forecast real-world events by retrieving and reasoning over news. We show that this dependence on an open, crawlable news corpus creates a new attack surface: an adversary who can merely publish articles--without access to the retriever, the model, or the user's queries--can systematically move the forecaster's output probabilities. We formalize news-corpus poisoning of probabilistic forecasters, a threat model distinct from prior RAG poisoning, which targets factual answers or opinion polarity rather than calibrated probabilities. We evaluate the attack on 500 resolved ForecastBench questions against a 17.4M-article Common Crawl News corpus with a strict crawl-date cutoff, using three retrieval-augmented forecasters built on open 7-8B models. A single LLM-written article per question flips 56% of forecasts across the 0.5 boundary; five articles flip 69-73% and shift probabilities by +0.13 to +0.22 net of a neutral-article placebo, degrading the Brier score from 0.18 to 0.37. The effect is monotone in the number, retrieval rank, query similarity, and context share of injected articles, transfers across model families, and is unaffected by the claimed publisher. We then evaluate three natural defenses--source allow-lists, isolate-then-aggregate forecasting, and perplexity filtering--and show that each has a cheap bypass: spoofed publishers, majority poisoning, and higher-temperature generation, respectively. Our results indicate that probabilistic LLM judgments inherit the full fragility of the information supply chain they consume.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 26 references that are in the map. First posted on arXiv 5 Sep 2026.

Builds on

20 of 26 references.

References · 20

  1. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
  2. 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 267
  3. 2023Poisoning Retrieval Corpora by Injecting Adversarial Passagescited by 159
  4. 2024Certifiably Robust RAG against Retrieval Corruptioncited by 151
  5. 2024ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilitiescited by 110
  6. 2024Approaching Human-Level Forecasting with Language Modelscited by 107
  7. 2024BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Modelscited by 86
  8. 2024TrojanRAG: Retrieval-Augmented Generation Can Be Backdoor Driver in Large Language Modelscited by 67
  9. 2022Forecasting Future World Events with Neural Networkscited by 63
  10. 2025FutureX: An Advanced Live Benchmark for LLM Agents in Future Predictioncited by 59
  11. 2025Topic-FlipRAG: Topic-Orientated Adversarial Opinion Manipulation Attacks to Retrieval-Augmented Generation Modelscited by 33
  12. 2025Traceback of Poisoning Attacks to Retrieval-Augmented Generationcited by 28
8 more
  1. 2025FlippedRAG: Black-Box Opinion Manipulation Adversarial Attacks to Retrieval-Augmented Generation Modelscited by 25
  2. 2024Adversarial Vulnerabilities in Large Language Models for Time Series Forecastingcited by 6
  3. 2026How Much Can We Trust LLM Search Agents? Measuring Endorsement Vulnerability to Web Content Manipulationcited by 6
  4. 2024Towards Certification of Uncertainty Calibration under Adversarial Attackscited by 5
  5. 2026Is Deep Research Reliable? Misleading Knowledge Induces False Conclusionscited by 4
  6. 2026AutoRedTrader: Autonomous Red Teaming of Trading Agents through Synthetic Misinformation Injectioncited by 3
  7. 2026What LLM Forecasters Know but Don't Say: Probing Internal Representations for Calibration and Faithfulnesscited by 2
  8. 2026Belief Propagation in LLM World Models: Measuring Strategic Information Bias with Prediction Marketscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflection
  2. 2026WorldReasoner: Evaluating Whether Language Model Agents Forecast Events with Valid Reasoning
  3. 2025Scaling Open-Ended Reasoning to Predict the Future
  4. 2026LLM-based Agents for Forecasting and Prediction: Methods, Training, Evaluation, and Applications
  5. 2025PROPHET: An Inferable Future Forecasting Benchmark with Causal Intervened Likelihood Estimation
  6. 2024From Deception to Detection: The Dual Roles of Large Language Models in Fake News
  7. 2024News Reporter: A Multi-lingual LLM Framework for Broadcast T.V News
  8. 2026From Long News to Accurate Forecast: Importance-Aware Fusion and PRM-Guided Reflection for Time Series Forecasting