mlsanityData to 7 Oct 2026

The Judgment-Consequence Gap: LLM Moral Reasoning in Healthcare Decisions

arXiv 2608.05583 ↗First posted 6 Aug 2026cs.CY cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

As large language models (LLMs) enter high-stakes domains such as healthcare, understanding their moral reasoning becomes essential. Decisions about scarce medical resources often hinge on judgments of responsibility, particularly when patients' own actions contribute to illness. We investigate how LLMs reason about responsibility and its consequences, tracing their judgments across successive levels, from the behavior, to the resulting illness, to the denial of care. We evaluate a wide range of LLMs, spanning different model families and capability levels, on various clinical vignettes adapted from prior studies. Our results identify a judgment-consequence gap: LLMs largely agree with humans that patients bear responsibility for health-harming behaviors, yet overwhelmingly refuse to let that judgment influence how they allocate scarce resources. Specifically, LLMs default to random allocation, whereas humans consistently favor the less-culpable patient. Compared to humans, LLMs also place greater emphasis on access to information, reducing responsibility judgments when health-risk knowledge is unavailable. These findings reveal that LLMs apply a systematically different moral framework than humans when responsibility and resource scarcity intersect, surprisingly often amplifying normative disagreement with humans as reasoning capability increases.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 31 of its 87 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

31 of 87 references.

References · 31

  1. 2017Deep reinforcement learning from human preferencescited by 3,846
  2. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  3. 2023Whose Opinions Do Language Models Reflect?cited by 759
  4. 2020Aligning AI With Shared Human Valuescited by 706
  5. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
  6. 2023Evaluating the Moral Beliefs Encoded in LLMscited by 211
  7. 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 145
  8. 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 137
  9. 2025LLM Social Simulations Are a Promising Research Methodcited by 97
  10. 2024SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agentscited by 89
  11. 2025Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinionscited by 64
  12. 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 49
19 more
  1. 2025SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviorscited by 48
  2. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  3. 2023Exploring the psychology of LLMs' Moral and Legal Reasoningcited by 43
  4. 2020Adapting a Kidney Exchange Algorithm to Align with Human Valuescited by 36
  5. 2025Finetuning LLMs for Human Behavior Prediction in Social Science Experimentscited by 35
  6. 2024Strong and weak alignment of large language models with human valuescited by 27
  7. 2024'Simulacrum of Stories': Examining Large Language Models as Qualitative Research Participantscited by 27
  8. 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMscited by 20
  9. 2025Large Language Models Do Not Simulate Human Psychologycited by 17
  10. 2025Personality-Driven Decision-Making in LLM-Based Autonomous Agentscited by 13
  11. 2025Distributive Fairness in Large Language Models: Evaluating Alignment with Human Valuescited by 9
  12. 2025Modeling Earth-Scale Human-Like Societies with One Billion Agentscited by 8
  13. 2025Susceptibility of Large Language Models to User-Driven Factors in Medical Queriescited by 6
  14. 2026Knowing But Not Doing: Convergent Morality and Divergent Action in LLMscited by 6
  15. 2026Strategic Algorithmic Monoculture: Experimental Evidence from Coordination Gamescited by 6
  16. 2025Leveraging LLM-based agents for social science research: insights from citation network simulationscited by 5
  17. 2025Moral Change or Noise? On Problems of Aligning AI With Temporally Unstable Human Feedbackcited by 5
  18. 2025"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmascited by 3
  19. 2026Expressing Social Emotions: Misalignment Between LLMs and Human Cultural Emotion Normscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas
  2. 2026How Does Thinking Mode Change LLM Moral Judgments? A Controlled Instant-vs-Thinking Comparison Across Five Frontier Models
  3. 2025The Greatest Good Benchmark: Measuring LLMs' Alignment with Utilitarian Moral Dilemmas
  4. 2025Discerning What Matters: A Multi-Dimensional Assessment of Moral Competence in LLMs
  5. 2026CORDA: A Benchmark for Hierarchical Harm-Centric Moral Reasoning in Large Language Models
  6. 2025Many LLMs Are More Utilitarian Than One
  7. 2025MedEthicEval: Evaluating Large Language Models Based on Chinese Medical Ethics
  8. 2025Are Language Models Consequentialist or Deontological Moral Reasoners?