mlsanityData to 7 Oct 2026

Saying More Than They Know: A Framework for Quantifying Epistemic-Rhetorical Miscalibration in Large Language Models

arXiv 2604.19768 ↗First posted 27 Mar 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) exhibit systematic miscalibration with rhetorical intensity not proportionate to epistemic grounding. This study tests this hypothesis and proposes a framework for quantifying this decoupling by designing a triadic epistemic-rhetorical marker (ERM) taxonomy. The taxonomy is operationalized through composite metrics of form-meaning divergence (FMD), genuine-to-performed epistemic ratio (GPR), and rhetorical device distribution entropy (RDDE). Applied to 225 argumentative texts spanning approximately 0.6 Million tokens across human expert, human non-expert, and LLM-generated sub-corpora, the framework identifies a consistent, model-agnostic LLM epistemic signature. LLM-generated texts produce tricolon at nearly twice the expert rate (Delta = 0.95), while human authors produce erotema at more than twice the LLM rate. Performed hesitancy markers appear at twice the human density in LLM output. FMD is significantly elevated in LLM texts relative to both human groups (p < 0.001, Delta = 0.68), and rhetorical devices are distributed significantly more uniformly across LLM documents. The findings are consistent with theoretical intuitions derived from Gricean pragmatics, Relevance Theory, and Brandomian inferentialism. The annotation pipeline is fully automatable, making it deployable as a lightweight screening tool for epistemic miscalibration in AI-generated content and as a theoretically motivated feature set for LLM-generated text detection pipelines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 38 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

15 of 38 references.

References · 15

  1. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  2. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  3. 2016Parsing Argumentation Structures in Persuasive Essayscited by 99
  4. 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
  5. 2024Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluationcited by 29
  6. 2024A Comprehensive Survey of Bias in LLMs: Current Landscape and Future Directionscited by 27
  7. 2024Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)cited by 20
  8. 2024Breaking Bias, Building Bridges: Evaluation and Mitigation of Social Biases in LLMs via Contact Hypothesiscited by 19
  9. 2025Epistemic Alignment: A Mediating Framework for User-LLM Knowledge Deliverycited by 14
  10. 2023Neural Authorship Attribution: Stylometric Analysis on Large Language Modelscited by 11
  11. 2025I Know Which LLM Wrote Your Code Last Summer: LLM generated Code Stylometry for Authorship Attributioncited by 9
  12. 2024Developing Safe and Responsible Large Language Model : Can We Balance Bias Reduction and Language Understanding in Large Language Models?cited by 8
3 more
  1. 2025Can Large Language Models Express Uncertainty Like Human?cited by 5
  2. 2025A Lightweight Approach to Detection of AI-Generated Texts Using Stylometric Featurescited by 4
  3. 2025Representations of Fact, Fiction and Forecast in Large Language Models: Epistemics and Attitudescited by 3

Built on by

Not cited yet.