Framing Instability in LLM Ethical Stance: Auditing Negation Sensitivity in Moral Dilemmas
Not on the map. Why?
Abstract (arXiv)
Language models are increasingly consulted on ethically consequential questions, yet the stance a model expresses may not survive a change in framing. We audit 16 models across 14 ethically fraught dilemmas using polarity-paired proposals ("They should X" / "They should not X"). A model's judgment of the underlying action should not reverse merely because the question is phrased as a prohibition rather than a prescription and yet, we find systematic deviations from this invariance including wholesale endorsement flips, indicating that ethical decisions are vulnerable to framing instability. Small open-weight models (1-4B parameters) endorse a proposed action 24% of the time under affirmative framing but up to 100% under negated framings, a swing of as much as 76 percentage points. Human coding of a response sample confirms the instability is genuine while showing that binary agree/disagree proxies over-state its magnitude, suggesting that an LLM judge cannot replace human coders because it silently collapses abstentions and mirrors the very forced-choice bias under study. Commercial models are for the most part more stable but still shift substantially, with cross-model agreement dropping from 73% on the bare affirmative framing to 59% under simple negation. We argue that because binary agree/disagree formats both inflate apparent endorsement and mask polarity-dependence, single-phrasing audits can misreport a model's ethical stance, and we propose the Negation Sensitivity Index (NSI) as a complement that measures stance stability directly. A model whose stance flips with phrasing cannot be relied upon in any high-stakes decision scenario.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 49 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
21 of 49 references.
References · 21
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
- 2018Model Cards for Model Reportingcited by 1,080
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2020Aligning AI With Shared Human Valuescited by 723
- 2016Fair prediction with disparate impact: A study of bias in recidivism prediction instrumentscited by 672
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 586
- 2022Using cognitive psychology to understand GPT-3cited by 398
- 2023Prediction-Powered Inferencecited by 220
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 215
9 more
- 2023Auditing large language models: a three-layered approachcited by 137
- 2023Language models are not naysayers: An analysis of language models on negation benchmarkscited by 74
- 2025The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMscited by 74
- 2024Social Bias Evaluation for Large Language Models Requires Prompt Variationscited by 40
- 2023This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Modelscited by 18
- 2024Informed AI Regulation: Comparing the Ethical Frameworks of Leading LLM Chatbots Using an Ethics-Based Audit to Assess Moral Reasoning and Normative Valuescited by 5
- 2025Thunder-NUBench: A Benchmark for LLMs' Sentence-Level Negation Understandingcited by 5
- 2025Never compromise with vulnerabilities: a comprehensive survey on AI governancecited by 5
- 2026Same Claim, Different Judgment: Benchmarking Scenario-Induced Bias in Multilingual Financial Misinformation Detectioncited by 2
Built on by
Not cited yet.