mlsanityData to 7 Oct 2026

On Epistemic Diversity in Large Language Models

arXiv 2609.04835 ↗First posted 4 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly used not only to retrieve information, but to answer questions, explain, teach, and support inquiry. In such settings, evaluation cannot be exhausted by accuracy or alignment alone. A system may give a correct answer while still narrowing users' access %to knowledge. to alternative valid answers, explanations, or reasoning routes. Drawing on the broader notion of epistemic diversity in philosophy and social epistemology, we formalize it in the context of LLMs as the range of valid answers, explanations, and reasoning routes that an LLM exposes to users. We argue that epistemic diversity is a useful evaluation dimension for settings where LLMs are used to support knowledge-intensive tasks. We propose a preliminary framework for conceptualizing and measuring epistemic diversity in LLMs, and operationalize it in two domains. We find that frontier LLMs often exhibit epistemic narrowness, repeatedly collapsing large valid answer spaces onto small canonical subsets. These findings suggest that LLM evaluation should move beyond accuracy-oriented paradigms and treat epistemic diversity as an important dimension of model capability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 55 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

29 of 55 references.

References · 29

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  2. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  3. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  4. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  5. 2018Model Cards for Model Reportingcited by 1,068
  6. 2023Whose Opinions Do Language Models Reflect?cited by 759
  7. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
  8. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
  9. 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 368
  10. 2022A Contrastive Framework for Neural Text Generationcited by 224
  11. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
  12. 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
17 more
  1. 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 137
  2. 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 137
  3. 2024Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Taskscited by 102
  4. 2024Is Temperature the Creativity Parameter of Large Language Models?cited by 92
  5. 2025Evaluating the Diversity and Quality of LLM Generated Contentcited by 51
  6. 2024Echoes in AI: Quantifying lack of plot diversity in LLM outputscited by 47
  7. 2023Improving Diversity of Demographic Representation in Large Language Models via Collective-Critiques and Self-Votingcited by 46
  8. 2024Limits to scalable evaluation at the frontier: LLM as Judge won't beat twice the datacited by 46
  9. 2024Benchmarking Linguistic Diversity of Large Language Modelscited by 37
  10. 2025Measuring Data Diversity for Instruction Tuning: A Systematic Analysis and A Reliable Metriccited by 24
  11. 2017Quantifying Search Bias: Investigating Sources of Bias for Political Searches in Social Mediacited by 18
  12. 2023Geographical Erasure in Language Generationcited by 15
  13. 2025The Value of Disagreement in AI Design, Evaluation, and Alignmentcited by 12
  14. 2024Growing a Tail: Increasing Output Diversity in Large Language Modelscited by 9
  15. 2025SATA-BENCH: Select All That Apply Benchmark for Multiple Choice Questionscited by 9
  16. 2025Avoidance Decoding for Diverse Multi-Branch Story Generationcited by 6
  17. 2024One world, one opinion? The superstar effect in LLM responsescited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025What and Whose Knowledge? Measuring Epistemic Diversity in Large Language Models
  2. 2024Diversity of Thought Elicits Stronger Reasoning Capabilities in Multi-Agent Debate Frameworks
  3. 2026Toward Responsible and Epistemically Grounded Multilingual LLMs for Computational Social Science and Humanities
  4. 2025Epistemological Fault Lines Between Human and Artificial Intelligence
  5. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debate
  6. 2026Exploring Knowledge Conflicts for Faithful LLM Reasoning: Benchmark and Method
  7. 2026Beyond Sally-Anne: Evaluating Theory of Mind in LLMs using Epistemic Schelling Points
  8. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers