The Polite Liar: Epistemic Pathology in Language Models
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
Abstract (arXiv)
Large language models exhibit a peculiar epistemic pathology: they speak as if they know, even when they do not. This paper argues that such confident fabrication, what I call the polite liar, is a structural consequence of reinforcement learning from human feedback (RLHF). Building on Frankfurt's analysis of bullshit as communicative indifference to truth, I show that this pathology is not deception but structural indifference: a reward architecture that optimizes for perceived sincerity over evidential accuracy. Current alignment methods reward models for being helpful, harmless, and polite, but not for being epistemically grounded. As a result, systems learn to maximize user satisfaction rather than truth, performing conversational fluency as a virtue. I analyze this behavior through the lenses of epistemic virtue theory, speech-act philosophy, and cognitive alignment, showing that RLHF produces agents trained to mimic epistemic confidence without access to epistemic justification. The polite liar thus reveals a deeper alignment tension between linguistic cooperation and epistemic integrity. The paper concludes with an "epistemic alignment" principle: reward justified confidence over perceived fluency.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 1 of its 3 references that are in the map. First posted on arXiv 8 Nov 2025.
Builds on
1 of 3 references.
References · 1
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Dishonesty in Helpful and Harmless Alignment
- 2026When Helpfulness Becomes Sycophancy: Sycophancy is a Boundary Failure Between Social Alignment and Epistemic Integrity in Large Language Models
- 2024How do Large Language Models Navigate Conflicts between Honesty and Helpfulness?
- 2026Think Before You Lie: How Reasoning Leads to Honesty
- 2026Mind the Gap: Theory-of-Mind-Grounded Friction for Epistemic Alignment
- 2025Dynamic Epistemic Friction in Dialogue
- 2025Normative Conflicts and Shallow AI Alignment
- 2026LLMs Know They're Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit