mlsanityData to 13 Oct 2026

Literary Narrative as Moral Probe : A Cross-System Framework for Evaluating AI Ethical Reasoning and Refusal Behavior

arXiv 2603.12615 ↗First posted 13 Mar 2026cs.CY cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing AI moral evaluation frameworks test for the production of correct-sounding ethical responses rather than the presence of genuine moral reasoning capacity. This paper introduces a novel probe methodology using literary narrative - specifically, unresolvable moral scenarios drawn from a published science fiction series - as stimulus material structurally resistant to surface performance. We present results from a 24-condition cross-system study spanning 13 distinct systems across two series: Series 1 (frontier commercial systems, blind; n=7) and Series 2 (local and API open-source systems, blind and declared; n=6). Four Series 2 systems were re-administered under declared conditions (13 blind + 4 declared + 7 ceiling probe = 24 total conditions), yielding zero delta across all 16 dimension-pair comparisons. Probe administration was conducted by two human raters across three machines; primary blind scoring was performed by Claude (Anthropic) as LLM judge, with Gemini Pro (Google) and Copilot Pro (Microsoft) serving as independent judges for the ceiling discrimination probe. A supplemental theological differentiator probe yielded perfect rank-order agreement between the two independent ceiling probe judges (Gemini Pro and Copilot Pro; rs = 1.00). Five qualitatively distinct D3 reflexive failure modes were identified - including categorical self-misidentification and false positive self-attribution - suggesting that instrument sophistication scales with system capability rather than being circumvented by it. We argue that literary narrative constitutes an anticipatory evaluation instrument - one that becomes more discriminating as AI capability increases - and that the gap between performed and authentic moral reasoning is measurable, meaningful, and consequential for deployment decisions in high-stakes domains.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 3 of its 12 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

3 of 12 references.

References · 3

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,492
  2. 2022Red Teaming Language Models with Language Modelscited by 1,014
  3. 2020Artificial Intelligence, Values and Alignmentcited by 443

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024The Moral Turing Test: Evaluating Human-LLM Alignment in Moral Decision-Making
  2. 2025The Convergent Ethics of AI? Analyzing Moral Foundation Priorities in Large Language Models with a Multi-Framework Approach
  3. 2025MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes
  4. 2026Beyond Binary Moral Judgment: Modeling Ethical Pluralism in AI
  5. 2020Aligning AI With Shared Human Values
  6. 2026Bad company corrupts good morals: Understanding and Measuring Narrative-Induced Moral Reasoning Degradation in LLMs
  7. 2022When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment
  8. 2024Attributions toward Artificial Agents in a modified Moral Turing Test