mlsanityData to 7 Oct 2026

The Polite Liar: Epistemic Pathology in Language Models

arXiv 2511.07477 ↗First posted 8 Nov 2025cs.CY cs.AI cs.CLcited by 2

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

Large language models exhibit a peculiar epistemic pathology: they speak as if they know, even when they do not. This paper argues that such confident fabrication, what I call the polite liar, is a structural consequence of reinforcement learning from human feedback (RLHF). Building on Frankfurt's analysis of bullshit as communicative indifference to truth, I show that this pathology is not deception but structural indifference: a reward architecture that optimizes for perceived sincerity over evidential accuracy. Current alignment methods reward models for being helpful, harmless, and polite, but not for being epistemically grounded. As a result, systems learn to maximize user satisfaction rather than truth, performing conversational fluency as a virtue. I analyze this behavior through the lenses of epistemic virtue theory, speech-act philosophy, and cognitive alignment, showing that RLHF produces agents trained to mimic epistemic confidence without access to epistemic justification. The polite liar thus reveals a deeper alignment tension between linguistic cooperation and epistemic integrity. The paper concludes with an "epistemic alignment" principle: reward justified confidence over perceived fluency.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 1 of its 3 references that are in the map. First posted on arXiv 8 Nov 2025.

Builds on

1 of 3 references.

References · 1

  1. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Dishonesty in Helpful and Harmless Alignment
  2. 2026When Helpfulness Becomes Sycophancy: Sycophancy is a Boundary Failure Between Social Alignment and Epistemic Integrity in Large Language Models
  3. 2024How do Large Language Models Navigate Conflicts between Honesty and Helpfulness?
  4. 2026Think Before You Lie: How Reasoning Leads to Honesty
  5. 2026Mind the Gap: Theory-of-Mind-Grounded Friction for Epistemic Alignment
  6. 2025Dynamic Epistemic Friction in Dialogue
  7. 2025Normative Conflicts and Shallow AI Alignment
  8. 2026LLMs Know They're Wrong and Agree Anyway: The Shared Sycophancy-Lying Circuit