Implicit Values Embedded in How Humans and LLMs Complete Subjective Everyday Tasks
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) can underpin AI assistants that help users with everyday tasks, such as by making recommendations or performing basic computation. Despite AI assistants' promise, little is known about the implicit values these assistants display while completing subjective everyday tasks. Humans may consider values like environmentalism, charity, and diversity. To what extent do LLMs exhibit these values in completing everyday tasks? How do they compare with humans? We answer these questions by auditing how six popular LLMs complete 30 everyday tasks, comparing LLMs to each other and to 100 human crowdworkers from the US. We find LLMs often do not align with humans, nor with other LLMs, in the implicit values exhibited.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 84 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
32 of 84 references.
References · 32
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2018Hierarchical Neural Story Generationcited by 1,182
- 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 211
- 2021Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Docited by 178
- 2024The BrowserGym Ecosystem for Web Agent Researchcited by 152
- 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
- 2023Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMscited by 64
- 2021Designing Toxic Content Classification for a Diversity of Perspectivescited by 63
- 2023NormBank: A Knowledge Bank of Situational Social Normscited by 60
20 more
- 2024Are Large Language Models Consistent over Value-laden Questions?cited by 58
- 2023MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Taskscited by 44
- 2024Evaluating Cultural and Social Awareness of LLM Web Agentscited by 43
- 2025Large Language Model Psychometrics: A Systematic Review of Evaluation, Validation, and Enhancementcited by 41
- 2023Flames: Benchmarking Value Alignment of LLMs in Chinesecited by 35
- 2024KorNAT: LLM Alignment Benchmark for Korean Social Values and Common Knowledgecited by 33
- 2023This Land is {Your, My} Land: Evaluating Geopolitical Biases in Language Modelscited by 31
- 2025An Evaluation of Cultural Value Alignment in LLMcited by 28
- 2024Strong and weak alignment of large language models with human valuescited by 27
- 2024LLM-GLOBE: A Benchmark Evaluating the Cultural Values Embedded in LLM Outputcited by 27
- 2023Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learningcited by 26
- 2023Probing the Moral Development of Large Language Models through Defining Issues Testcited by 23
- 2024MoralBERT: A Fine-Tuned Language Model for Capturing Moral Values in Social Discussionscited by 23
- 2024CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responsescited by 23
- 2024Exploring and steering the moral compass of Large Language Modelscited by 15
- 2024Beyond Human Norms: Unveiling Unique Values of Large Language Models through Interdisciplinary Approachescited by 13
- 2024Decoding Multilingual Moral Preferences: Unveiling LLM's Biases Through the Moral Machine Experimentcited by 11
- 2024As an AI Language Model, "Yes I Would Recommend Calling the Police": Norm Inconsistency in LLM Decision-Makingcited by 10
- 2024Beyond Static Evaluation: A Dynamic Approach to Assessing AI Assistants' API Invocation Capabilitiescited by 6
- 2024Beyond Personhood: Agency, Accountability, and the Limits of Anthropomorphic Ethical Analysiscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.