The Oracle's Fingerprint: Correlated AI Forecasting Errors and the Limits of Bias Transmission
Not on the map. Why?
Abstract (arXiv)
When large language models (LLMs) are consulted as forecasting tools, the independence of individual errors -- the foundation of collective intelligence -- may collapse. We test three conditions necessary for this "epistemic monoculture" to emerge. In Study 1, we show that GPT-4o, Claude, and Gemini exhibit highly correlated forecasting errors on 568 resolved binary prediction questions (mean pairwise error correlation r = 0.77, p < 0.001; r = 0.78 excluding likely-leaked questions), despite being developed independently by different organizations. In Study 2, we test whether this correlated bias has propagated into human crowd forecasts, using a within-question design that tracks community prediction shifts across the ChatGPT launch boundary (November 2022). We find that community forecasts move in the direction predicted by LLMs (r = 0.20, p = 0.007), but this shift is fully explained by rational updating toward ground truth. In Study 3, we examine whether the category-level pattern of human forecasting errors increasingly resembles the LLM bias fingerprint. We find the opposite: pre-ChatGPT human biases already strongly resembled the LLM pattern (r = 0.87), while post-ChatGPT the resemblance weakened (r = -0.28). Together, these findings reveal an epistemic monoculture that is built but not yet activated: three nominally independent AI systems share the same failure modes, amplifying precisely the biases humans already hold.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 5 of its 19 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
5 of 19 references.
References · 5
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Modelscited by 125
- 2024Approaching Human-Level Forecasting with Language Modelscited by 102
- 2021Algorithmic Monoculture and Social Welfarecited by 98
- 2024AI-Augmented Predictions: LLM Assistants Improve Human Forecasting Accuracycited by 21
Built on by
Citing papers per year: 2026: 3.
3 papers.