Plausibility as Failure: How LLMs and Humans Co-Construct Epistemic Error
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used as epistemic partners in everyday reasoning, yet their errors remain predominantly analyzed through predictive metrics rather than through their interpretive effects on human judgment. This study examines how different forms of epistemic failure emerge, are masked, and are tolerated in human AI interaction, where failure is understood as a relational breakdown shaped by model-generated plausibility and human interpretive judgment. We conducted a three round, multi LLM evaluation using interdisciplinary tasks and progressively differentiated assessment frameworks to observe how evaluators interpret model responses across linguistic, epistemic, and credibility dimensions. Our findings show that LLM errors shift from predictive to hermeneutic forms, where linguistic fluency, structural coherence, and superficially plausible citations conceal deeper distortions of meaning. Evaluators frequently conflated criteria such as correctness, relevance, bias, groundedness, and consistency, indicating that human judgment collapses analytical distinctions into intuitive heuristics shaped by form and fluency. Across rounds, we observed a systematic verification burden and cognitive drift. As tasks became denser, evaluators increasingly relied on surface cues, allowing erroneous yet well formed answers to pass as credible. These results suggest that error is not solely a property of model behavior but a co-constructed outcome of generative plausibility and human interpretive shortcuts. Understanding AI epistemic failure therefore requires reframing evaluation as a relational interpretive process, where the boundary between system failure and human miscalibration becomes porous. The study provides implications for LLM assessment, digital literacy, and the design of trustworthy human AI communication.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 70 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
28 of 70 references.
References · 28
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
- 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
- 2025Why Language Models Hallucinatecited by 220
- 2020USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generationcited by 188
- 2024What Large Language Models Know and What People Think They Knowcited by 110
- 2022Towards Human-centered Explainable AI: A Survey of User Studies for Model Explanationscited by 85
- 2024LLMs Will Always Hallucinate, and We Need to Live With Thiscited by 78
- 2024A Framework for Human Evaluation of Large Language Models in Healthcare Derived from Literature Reviewcited by 66
16 more
- 2025Evaluating Step-by-step Reasoning Traces: A Surveycited by 63
- 2025A Survey on the Optimization of Large Language Model-based Agentscited by 46
- 2024Uncertainty Quantification for In-Context Learning of Large Language Modelscited by 45
- 2025A Survey on Large Language Model Benchmarkscited by 36
- 2024Trust in AI: Progress, Challenges, and Future Directionscited by 35
- 2023Foundation Metrics for Evaluating Effectiveness of Healthcare Conversations Powered by Generative AIcited by 32
- 2022Achieving Reliable Human Assessment of Open-Domain Dialogue Systemscited by 31
- 2024Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Surveycited by 23
- 2023Transformative Effects of ChatGPT on Modern Education: Emerging Era of AI Chatbotscited by 18
- 2024The Challenges of Evaluating LLM Applications: An Analysis of Automated, Human, and LLM-Based Approachescited by 18
- 2025Evaluating LLM Metrics Through Real-World Capabilitiescited by 18
- 2021Designing Effective Interview Chatbots: Automatic Chatbot Profiling and Design Suggestion Generation for Chatbot Debuggingcited by 12
- 2024Improving LLM Classification of Logical Errors by Integrating Error Relationship into Promptscited by 5
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
- 2024Understanding the concerns and choices of public when using large language models for healthcarecited by 3
- 2025Evaluating Conversational Recommender Systems via Large Language Models: A User-Centric Frameworkcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.