mlsanityData to 14 Oct 2026

What Does the AI Doctor Value? Auditing Pluralism in the Clinical Ethics of Language Models

arXiv 2605.18738 ↗First posted 18 May 2026cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Medicine is inherently pluralistic. Principles such as autonomy, beneficence, nonmaleficence, and justice routinely conflict, and such ethical dilemmas often sharply divide reasonable physicians. Good clinical practice navigates these tensions in concert with each patient's values rather than imposing a single ethical stance. The ethical values that large language models bring to medical advice, however, have not been systematically examined. We present a framework for auditing value pluralism in medical AI, comprising a benchmark of clinician-verified dilemmas and an attribution method that recovers value priorities directly from decisions. The ecosystem of frontier models spans physician-level value heterogeneity, and models discuss competing values in their reasoning (Overton pluralism) before committing to a decision. However, individual model decisions are near-deterministic across repeated sampling and semantic variations, failing to reproduce the distributional pluralism of the physician panel. Across benchmark cases, these consistent decisions reflect committed, systematic value preferences. While most model priorities fall within the natural range of inter-physician variation, some significantly underweight patient autonomy. A single LLM deployed without regard for its value priorities could amplify those priorities at scale to every patient it serves. Without explicit efforts to balance ethical perspectives with one or multiple models, these tools risk replacing clinical pluralism with a deployment monoculture.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 16 of its 38 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

16 of 38 references.

References · 16

  1. 2024A Roadmap to Pluralistic Alignmentcited by 184
  2. 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 172
  3. 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
  4. 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 51
  5. 2024The Ethics of ChatGPT in Medicine and Healthcare: A Systematic Review on Large Language Models (LLMs)cited by 45
  6. 2023Assessing LLMs for Moral Value Pluralismcited by 34
  7. 2024Can Language Models Reason about Individualistic Human Values and Preferences?cited by 34
  8. 2024Evaluating the Prompt Steerability of Large Language Modelscited by 27
  9. 2025LLM Ethics Benchmark: A Three-Dimensional Assessment System for Evaluating Moral Reasoning in Large Language Modelscited by 21
  10. 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMscited by 20
  11. 2025VITAL: A New Dataset for Benchmarking Pluralistic Alignment in Healthcarecited by 17
  12. 2025STEER-BENCH: A Benchmark for Evaluating the Steerability of Large Language Modelscited by 8
4 more
  1. 2025MedEthicsQA: A Comprehensive Question Answering Benchmark for Medical Ethics Evaluation of LLMscited by 8
  2. 2025Benchmarking Overton Pluralism in LLMscited by 7
  3. 2025Deep Value Benchmark: Measuring Whether Models Generalize Deep Values or Shallow Preferencescited by 6
  4. 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.