Hallucination is Inevitable for LLMs with the Open World Assumption
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) exhibit impressive linguistic competence but also produce inaccurate or fabricated outputs, often called ``hallucinations''. Engineering approaches usually regard hallucination as a defect to be minimized, while formal analyses have argued for its theoretical inevitability. Yet both perspectives remain incomplete when considering the conditions required for artificial general intelligence (AGI). This paper reframes ``hallucination'' as a manifestation of the generalization problem. Under the Closed World assumption, where training and test distributions are consistent, hallucinations may be mitigated. Under the Open World assumption, however, where the environment is unbounded, hallucinations become inevitable. This paper further develops a classification of hallucination, distinguishing cases that may be corrected from those that appear unavoidable under open-world conditions. On this basis, it suggests that ``hallucination'' should be approached not merely as an engineering defect but as a structural feature to be tolerated and made compatible with human intelligence.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 16 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
10 of 16 references.
References · 10
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
- 2023A Survey of Reinforcement Learning from Human Feedbackcited by 264
- 2025Why Language Models Hallucinatecited by 220
- 2024LLMs Will Always Hallucinate, and We Need to Live With Thiscited by 78
- 2025A comprehensive taxonomy of hallucinations in Large Language Modelscited by 18
- 2025Hallucinations are inevitable but can be made statistically negligiblecited by 5
- 2024What is Meant by AGI? On the Definition of Artificial General Intelligencecited by 2
- 2025Hallucination as a Computational Boundary: A Hierarchy of Inevitability and the Oracle Escapecited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.