Lessons Without Borders? Evaluating Cultural Alignment of LLMs Using Multilingual Story Moral Generation
Not on the map. Why?
Abstract (arXiv)
Stories are key to transmitting values across cultures, but their interpretation varies across linguistic and cultural contexts. Thus, we introduce multilingual story moral generation as a novel culturally grounded evaluation task. Using a new dataset of human-written story morals collected across 14 language-culture pairs, we compare model outputs with human interpretations via semantic similarity, a human preference survey, and value categorization. We show that frontier models such as GPT-4o and Gemini generate story morals that are semantically similar to human responses and preferred by human evaluators. However, their outputs exhibit markedly less cross-linguistic variation and concentrate on a narrower set of widely shared values. These findings suggest that while contemporary models can approximate central tendencies of human moral interpretation, they struggle to reproduce the diversity that characterizes human narrative understanding. By framing narrative interpretation as an evaluative task, this work introduces a new approach to studying cultural alignment in language models beyond static benchmarks or knowledge-based tests.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 75 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
21 of 75 references.
References · 21
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2020Aligning AI With Shared Human Valuescited by 706
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
- 2023Evaluating the Moral Beliefs Encoded in LLMscited by 211
- 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 181
- 2021Can Machines Learn Morality? The Delphi Experimentcited by 140
- 2025Randomness, Not Representation: The Unreliability of Evaluating Cultural Alignment in LLMscited by 54
- 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 49
- 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 36
- 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
- 2022A Corpus for Understanding and Generating Moral Storiescited by 16
- 2024Keeping Humans in the Loop: Human-Centered Automated Annotation with Generative AIcited by 16
9 more
- 2024ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understandingcited by 15
- 2025Biased Tales: Cultural and Topic Bias in Generating Children's Storiescited by 15
- 2025NarraBench: A Comprehensive Framework for Narrative Benchmarkingcited by 13
- 2024Developing Story: Case Studies of Generative AI's Use in Journalismcited by 10
- 2025Culture is Everywhere: A Call for Intentionally Cultural Evaluationcited by 10
- 2024Richer Output for Richer Countries: Uncovering Geographical Disparities in Generated Stories and Travel Recommendationscited by 9
- 2025MORABLES: A Benchmark for Assessing Abstract Moral Reasoning in LLMs with Fablescited by 9
- 2025MoVa: Towards Generalizable Classification of Human Morals and Valuescited by 7
- 2024Perfectly to a Tee: Understanding User Perceptions of Personalized LLM-Enhanced Narrative Interventionscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Cultural Bias in Large Language Models: Evaluating AI Agents through Moral Questionnaires
- 2024Whose Morality Do They Speak? Unraveling Cultural Bias in Multilingual Language Models
- 2025One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoning
- 2026Culturally Grounded Personas in Large Language Models: Characterization and Alignment with Socio-Psychological Value Frameworks
- 2025Histoires Morales: A French Dataset for Assessing Moral Alignment
- 2025Cultural Value Alignment in Large Language Models: A Prompt-based Analysis of Schwartz Values in Gemini, ChatGPT, and DeepSeek
- 2024Decoding Multilingual Moral Preferences: Unveiling LLM's Biases Through the Moral Machine Experiment
- 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?