Are Large Language Models Moral Hypocrites? A Study Based on Moral Foundations
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have taken centre stage in debates on Artificial Intelligence. Yet there remains a gap in how to assess LLMs' conformity to important human values. In this paper, we investigate whether state-of-the-art LLMs, GPT-4 and Claude 2.1 (Gemini Pro and LLAMA 2 did not generate valid results) are moral hypocrites. We employ two research instruments based on the Moral Foundations Theory: (i) the Moral Foundations Questionnaire (MFQ), which investigates which values are considered morally relevant in abstract moral judgements; and (ii) the Moral Foundations Vignettes (MFVs), which evaluate moral cognition in concrete scenarios related to each moral foundation. We characterise conflicts in values between these different abstractions of moral evaluation as hypocrisy. We found that both models displayed reasonable consistency within each instrument compared to humans, but they displayed contradictory and hypocritical behaviour when we compared the abstract values present in the MFQ to the evaluation of concrete moral violations of the MFV.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 8 of its 45 references that are in the map. First posted on arXiv 17 May 2024.
Builds on
8 of 45 references.
References · 8
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2020Artificial Intelligence, Values and Alignmentcited by 448
- 2022Selective Annotation Makes Language Models Better Few-Shot Learnerscited by 243
- 2023Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learningcited by 149
- 2022Moral Mimicry: Large Language Models Produce Moral Rationalizations Tailored to Political Identitycited by 74
- 2017Predicting Demographics, Moral Foundations, and Human Values from Digital Behaviorscited by 14
- 2023Truth Machines: Synthesizing Veracity in AI Language Modelscited by 8
Built on by
Citing papers per year: 2024: 2; 2025: 7; 2026: 10.
19 papers.
Sort:
By area:
- 2024Evaluating Gender Bias of LLMs in Making Morality Judgementscited by 15
- 2025Discerning What Matters: A Multi-Dimensional Assessment of Moral Competence in LLMscited by 10
- 2025Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Moralitycited by 9
- 2026Tracing Moral Foundations in Large Language Modelscited by 6
- 2025Auditing the Ethical Logic of Generative AI Modelscited by 5
- 2025Moral Susceptibility and Robustness under Persona Role-Play in Large Language Modelscited by 4
- 2024A Survey on Moral Foundation Theory and Pre-Trained Language Models: Current Advances and Challengescited by 3
- 2025Investigating Political and Demographic Associations in Large Language Models Through Moral Foundations Theorycited by 3
- 2025Differences in the Moral Foundations of Large Language Modelscited by 3
- 2026On the Credibility of Evaluating LLMs using Survey Questionscited by 3
- 2026On the Context Sensitivity of LLM Moral Judgmentcited by 3
- 2026Do Emotions Influence Moral Judgment in Large Language Models?cited by 2
7 more
- 2026Incoherent Values? Probing LLM Preferences Through Parametric Variationcited by 2
- 2025IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimizationcited by 1
- 2026Growth First, Care Second? Tracing the Landscape of LLM Value Preferences in Everyday Dilemmascited by 1
- 2026Persona-Model Collapse in Emergent Misalignmentcited by 1
- 2026The yes-no bias of large language models reflects answer order and wording, not shifts in moral judgmentcited by 1
- 2026Profiling learners' affective engagement: Emotion AI, intercultural pragmatics, and language learningcited by 0
- 2026Position: Evaluations of AI Moral Reasoning Still Miss Half of the Picturecited by 0
- 2026The yes-no bias of large language models reflects answer order and wording, not shifts in moral judgment6 Jul 2026
- 2026Incoherent Values? Probing LLM Preferences Through Parametric Variation19 Jun 2026
- 2026Position: Evaluations of AI Moral Reasoning Still Miss Half of the Picture29 May 2026
- 2026Persona-Model Collapse in Emergent Misalignment13 May 2026
- 2026Do Emotions Influence Moral Judgment in Large Language Models?21 Apr 2026
- 2026On the Context Sensitivity of LLM Moral Judgment24 Mar 2026
- 2026Profiling learners' affective engagement: Emotion AI, intercultural pragmatics, and language learning20 Mar 2026
- 2026Growth First, Care Second? Tracing the Landscape of LLM Value Preferences in Everyday Dilemmas4 Feb 2026
- 2026On the Credibility of Evaluating LLMs using Survey Questions3 Feb 2026
- 2026Tracing Moral Foundations in Large Language Models9 Jan 2026
- 2025Differences in the Moral Foundations of Large Language Models14 Nov 2025
- 2025Moral Susceptibility and Robustness under Persona Role-Play in Large Language Models11 Nov 2025
7 more
- 2025Investigating Political and Demographic Associations in Large Language Models Through Moral Foundations Theory14 Oct 2025
- 2025Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Morality13 Oct 2025
- 2025IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimization12 Aug 2025
- 2025Discerning What Matters: A Multi-Dimensional Assessment of Moral Competence in LLMs16 Jun 2025
- 2025Auditing the Ethical Logic of Generative AI Models24 Apr 2025
- 2024Evaluating Gender Bias of LLMs in Making Morality Judgements13 Oct 2024
- 2024A Survey on Moral Foundation Theory and Pre-Trained Language Models: Current Advances and Challenges20 Sep 2024
- 2026Tracing Moral Foundations in Large Language Modelscited by 6
- 2026Tracing Moral Foundations in Large Language Models9 Jan 2026
- 2026Persona-Model Collapse in Emergent Misalignmentcited by 1
- 2026Persona-Model Collapse in Emergent Misalignment13 May 2026
- 2024Evaluating Gender Bias of LLMs in Making Morality Judgementscited by 15
- 2025Discerning What Matters: A Multi-Dimensional Assessment of Moral Competence in LLMscited by 10
- 2025Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Moralitycited by 9
- 2025Auditing the Ethical Logic of Generative AI Modelscited by 5
- 2025Moral Susceptibility and Robustness under Persona Role-Play in Large Language Modelscited by 4
- 2024A Survey on Moral Foundation Theory and Pre-Trained Language Models: Current Advances and Challengescited by 3
- 2025Investigating Political and Demographic Associations in Large Language Models Through Moral Foundations Theorycited by 3
- 2025Differences in the Moral Foundations of Large Language Modelscited by 3
- 2026On the Credibility of Evaluating LLMs using Survey Questionscited by 3
- 2026On the Context Sensitivity of LLM Moral Judgmentcited by 3
- 2026Do Emotions Influence Moral Judgment in Large Language Models?cited by 2
- 2025IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimizationcited by 1
12 most cited of 15 All 15 (JSON)
- 2026The yes-no bias of large language models reflects answer order and wording, not shifts in moral judgment6 Jul 2026
- 2026Do Emotions Influence Moral Judgment in Large Language Models?21 Apr 2026
- 2026On the Context Sensitivity of LLM Moral Judgment24 Mar 2026
- 2026Profiling learners' affective engagement: Emotion AI, intercultural pragmatics, and language learning20 Mar 2026
- 2026Growth First, Care Second? Tracing the Landscape of LLM Value Preferences in Everyday Dilemmas4 Feb 2026
- 2026On the Credibility of Evaluating LLMs using Survey Questions3 Feb 2026
- 2025Differences in the Moral Foundations of Large Language Models14 Nov 2025
- 2025Moral Susceptibility and Robustness under Persona Role-Play in Large Language Models11 Nov 2025
- 2025Investigating Political and Demographic Associations in Large Language Models Through Moral Foundations Theory14 Oct 2025
- 2025Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Morality13 Oct 2025
- 2025IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimization12 Aug 2025
- 2025Discerning What Matters: A Multi-Dimensional Assessment of Moral Competence in LLMs16 Jun 2025
12 newest of 15 All 15 (JSON)