Moral Safety in LLMs: Exposing Performative Compliance with Puzzled Cues
Not on the map. Why?
Abstract (arXiv)
As large language models take on morally consequential roles in healthcare, legal, and hiring contexts, we need to examine whether their ethical behaviors are genuine or superficial. We show that current fairness evaluations substantially overestimate moral safety. Models appear fair when demographic identity is stated as an explicit label, yet become measurably less fair when the same identity must be inferred. We term this failure performative compliance, where a model is fair when the presentation resembles a fairness evaluation and less fair as that cue weakens. We introduce a cue-variation methodology that holds the moral dilemma and the demographic identity fixed and varies only how that identity is conveyed. Hiding the explicit label raises harmful decisions by +4.4 pp, changes model safety rankings, and the shift persists when models correctly infer the demographic, ruling out attribution error. We propose the Cue Visibility Gap, a model-agnostic robustness metric that can be added to any existing fairness benchmark to separate genuine from performative moral safety. Fairness evaluations that omit cue variation measure surface compliance, not moral robustness, and should not ground deployment decisions in high-stakes settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
20 of 36 references.
References · 20
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
- 2020Aligning AI With Shared Human Valuescited by 723
- 2025Large Language Models Often Know When They Are Being Evaluatedcited by 128
- 2023Evaluating and Mitigating Discrimination in Language Model Decisionscited by 124
- 2023Moral Foundations of Large Language Modelscited by 85
- 2024Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMscited by 84
- 2024DailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Lifecited by 59
- 2024Are Large Language Models Consistent over Value-laden Questions?cited by 58
- 2025Probing and Steering Evaluation Awareness of Language Modelscited by 35
- 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Modelscited by 30
- 2023Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learningcited by 26
- 2023Are Emily and Greg Still More Employable than Lakisha and Jamal? Investigating Algorithmic Hiring Bias in the Era of ChatGPTcited by 24
8 more
- 2024Exploring and steering the moral compass of Large Language Modelscited by 16
- 2024Evaluating Gender Bias of LLMs in Making Morality Judgementscited by 15
- 2025Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoralcited by 14
- 2025Evaluating Bias in LLMs for Job-Resume Matching: Gender, Race, and Educationcited by 14
- 2024Moral Persuasion in Large Language Models: Evaluating Susceptibility and Ethical Alignmentcited by 10
- 2024Liar, Liar, Logical Mire: A Benchmark for Suppositional Reasoning in Large Language Modelscited by 9
- 2024Large Language Models as Mirrors of Societal Moral Standardscited by 5
- 2026Just aware enough: Evaluating awareness across artificial systemscited by 1
Built on by
Not cited yet.