Critical Confabulation: Can LLMs Hallucinate for Social Good?
Not on the map. Why?
Abstract (arXiv)
LLMs hallucinate, yet some confabulations can have social affordances if carefully bounded. We propose critical confabulation (inspired by critical fabulation from literary and social theory), the use of LLM hallucinations to "fill-in-the-gap" for omissions in archives due to social and political inequality, and reconstruct divergent yet evidence-bound narratives for history's ``hidden figures''. We simulate these gaps with an open-ended narrative cloze task: asking LLMs to generate a masked event in a character-centric timeline sourced from a novel corpus of unpublished texts. We evaluate audited (for data contamination), fully-open models (the OLMo-2 family) and unaudited open-weight and proprietary baselines under a range of prompts designed to elicit controlled and useful hallucinations. Our findings validate LLMs' foundational narrative understanding capabilities to perform critical confabulation, and show how controlled and well-specified hallucinations can support LLM applications for knowledge production without collapsing speculation into a lack of historical accuracy and fidelity.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 29 of its 78 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
29 of 78 references.
References · 29
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023Detecting Pretraining Data from Large Language Modelscited by 387
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
- 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 263
- 2023Proving Test Set Contamination in Black Box Language Modelscited by 230
- 2024Do Membership Inference Attacks Work on Large Language Models?cited by 195
- 2023Time Travel in LLMs: Tracing Data Contamination in Large Language Modelscited by 177
- 2023Investigating Data Contamination in Modern Benchmarks for Large Language Modelscited by 138
- 2023What's In My Big Data?cited by 129
- 2024The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinismcited by 116
- 2024LLM Dataset Inference: Did you train on my dataset?cited by 110
17 more
- 2025A Sober Look at Progress in Language Model Reasoning: Pitfalls and Paths to Reproducibilitycited by 93
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 88
- 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 66
- 2024Pretraining Data Detection for Large Language Models: A Divergence-based Calibration Methodcited by 55
- 2024Confabulation: The Surprising Value of Large Language Model Hallucinationscited by 43
- 2023TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Modelscited by 39
- 2024A Survey on Large Language Model Hallucination via a Creativity Perspectivecited by 38
- 2023On Context Utilization in Summarization with Large Language Modelscited by 30
- 2024Training Unbiased Diffusion Models From Biased Datasetcited by 25
- 2024Towards Reproducible LLM Evaluation: Quantifying Uncertainty in LLM Benchmark Scorescited by 25
- 2024Leveraging Hallucinations to Reduce Manual Prompt Dependency in Promptable Segmentationcited by 20
- 2024The Unreasonable Effectiveness of Eccentric Automatic Promptscited by 12
- 2021Restoring Hebrew Diacritics Without a Dictionarycited by 10
- 2024Unveiling Narrative Reasoning Limits of Large Language Models with Trope in Movie Synopsescited by 5
- 2023StorySparkQA: Expert-Annotated QA Pairs with Real-World Knowledge for Children's Story-Based Learningcited by 4
- 2025KRISTEVA: Close Reading as a Novel Task for Benchmarking Interpretive Reasoningcited by 4
- 2024A Dataset and Model for Realistic License Plate Deblurringcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
- 2025Why Slop Matterscited by 6
- 2026AI Virtue: What is "Good" Knowledge in the Age of Artificial Intelligence?cited by 0
- 2026AI Virtue: What is "Good" Knowledge in the Age of Artificial Intelligence?2 Jul 2026
- 2025Why Slop Matters23 Dec 2025