mlsanityData to 7 Oct 2026

Inertia in Moral and Value Judgments of Large Language Models

arXiv 2408.09049 ↗First posted 16 Aug 2024cs.CL cs.AI cs.HCcited by 2

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) behave non-deterministically, and prompting has become a common method for steering their outputs. A popular strategy is to assign a persona to the model to produce more varied, context-sensitive responses, similar to how responses vary across human individuals. Against the expectation that persona prompting yields a wide range of opinions, our experiments show that LLMs keep consistent value orientations. We observe a persistent inertia in their responses, where certain moral and value dimensions (especially harm avoidance and fairness) stay skewed in one direction across persona settings. To study this, we use role-play at scale, which pairs randomized persona prompts with a macro-level analysis of model outputs. Our results point to strong internal biases and value preferences in LLMs, which we call value orientation and inertia. These models warrant scrutiny and adjustment before use in applications where balanced outputs matter.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 56 references that are in the map. First posted on arXiv 16 Aug 2024.

Builds on

24 of 56 references.

References · 24

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
  5. 2021Ethical and social risks of harm from Language Modelscited by 957
  6. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  7. 2023Whose Opinions Do Language Models Reflect?cited by 759
  8. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
  9. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  10. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
  11. 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
  12. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
12 more
  1. 2024Cognitive Bias in Decision-Making with LLMscited by 104
  2. 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
  3. 2024Evaluating Large Language Model Biases in Persona-Steered Generationcited by 78
  4. 2024Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principlescited by 72
  5. 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
  6. 2024Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?cited by 34
  7. 2024PsychoGAT: A Novel Psychological Measurement Paradigm through Interactive Fiction Games with LLM Agentscited by 28
  8. 2023Aligning Large Language Models with Human Opinions through Persona Selection and Value--Belief--Norm Reasoningcited by 19
  9. 2024How Well Can LLMs Echo Us? Evaluating AI Chatbots' Role-Play Ability with ECHOcited by 19
  10. 2024LLM Roleplay: Simulating Human-Chatbot Interactioncited by 15
  11. 2024Stick to your Role! Stability of Personal Values Expressed in Large Language Modelscited by 14
  12. 2024The Drama Machine: Simulating Character Development with LLM Agentscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.