mlsanityData to 7 Oct 2026

Knowing But Not Doing: Convergent Morality and Divergent Action in LLMs

arXiv 2601.07972 ↗First posted 12 Jan 2026cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Value alignment is central to the development of safe and socially compatible artificial intelligence. However, how Large Language Models (LLMs) represent and enact human values in real-world decision contexts remains under-explored. We present ValAct-15k, a dataset of 3,000 advice-seeking scenarios derived from Reddit, designed to elicit ten values defined by Schwartz Theory of Basic Human Values. Using both the scenario-based questions and the traditional value questionnaire, we evaluate ten frontier LLMs (five from U.S. companies, five from Chinese ones) and human participants (n = 55). We find near-perfect cross-model consistency in scenario-based decisions (Pearson r ≈ 1.0), contrasting sharply with the broad variability observed among humans (r ∈ [-0.79, 0.98]). Yet, both humans and LLMs show weak correspondence between self-reported and enacted values (r = 0.4, 0.3), revealing a systematic knowledge-action gap. When instructed to "hold" a specific value, LLMs' performance declines up to 6.6% compared to merely selecting the value, indicating a role-play aversion. These findings suggest that while alignment training yields normative value convergence, it does not eliminate the human-like incoherence between knowing and acting upon values.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 12 Jan 2026.

Builds on

20 of 40 references.

References · 20

  1. 2024Qwen2.5 Technical Reportcited by 4,713
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2025Kimi K2: Open Agentic Intelligencecited by 523
  4. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  5. 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 88
  6. 2024Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voterscited by 71
  7. 2024Are Large Language Models Consistent over Value-laden Questions?cited by 58
  8. 2024How Well Do LLMs Represent Values Across Cultures? Empirical Analysis of LLM Responses Based on Hofstede Cultural Dimensionscited by 51
  9. 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 49
  10. 2023Large Language Models as Superpositions of Cultural Perspectivescited by 48
  11. 2025Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactionscited by 47
  12. 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 35
8 more
  1. 2025Actions Speak Louder than Words: Agent Decisions Reveal Implicit Biases in Language Modelscited by 30
  2. 2024High-Dimension Human Value Representation in Large Language Modelscited by 20
  3. 2023What does ChatGPT return about human values? Exploring value bias in ChatGPT using a descriptive value theorycited by 19
  4. 2024Stick to your Role! Stability of Personal Values Expressed in Large Language Modelscited by 14
  5. 2024Do LLMs have Consistent Values?cited by 13
  6. 2023From Values to Opinions: Predicting Human Behaviors and Stances Using Value-Injected Large Language Modelscited by 10
  7. 2025SPeCtrum: A Grounded Framework for Multidimensional Identity Representation in LLM-Based Agentcited by 8
  8. 2025AdaptJobRec: Enhancing Conversational Career Recommendation through an LLM-Powered Agentic Systemcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.