mlsanityData to 14 Oct 2026

Human-like moral judgments conceal divergent motive attributions in large language models

arXiv 2609.07353 ↗First posted 7 Sep 2026cs.AI cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are used to simulate human participants in psychological research. We asked whether LLMs that reproduce human evaluations of a whistleblower's moral character also reproduce the motive attributions that accompany them. Five LLMs and two human samples (N = 125 and N = 742) evaluated a physician who either remained silent about fraudulent billing or reported it to a hospital, regulator, or newspaper. Models reproduced the human ranking of the physician's moral character but portrayed whistleblowers as more helpful, less self-interested, and less hostile. In four of five models, competitive motives were less strongly associated with moral-character judgments. Model ratings changed little when prompts reproduced the narratives and demographic profiles of both human samples, although this comparison cannot isolate a perspective effect. Thus, agreement in average ratings can conceal differences in attributed motives, relationships among judgments, and sensitivity to context. Validating LLMs as simulated participants therefore requires testing psychologically informative response patterns, not average agreement alone.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 36 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

7 of 36 references.

References · 7

  1. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  2. 2025Reasoning Models Don't Always Say What They Thinkcited by 415
  3. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
  4. 2023Evaluating Large Language Models in Theory of Mind Taskscited by 222
  5. 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 144
  6. 2024Six Fallacies in Substituting Large Language Models for Human Participantscited by 24
  7. 2025The threat of analytic flexibility in using large language models to simulate human datacited by 15

Built on by

Not cited yet.