mlsanityData to 14 Oct 2026

How Well Do LLMs Represent Values Across Cultures? Empirical Analysis of LLM Responses Based on Hofstede Cultural Dimensions

arXiv 2406.14805 ↗First posted 21 Jun 2024cs.CLcited by 52

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) attempt to imitate human behavior by responding to humans in a way that pleases them, including by adhering to their values. However, humans come from diverse cultures with different values. It is critical to understand whether LLMs showcase different values to the user based on the stereotypical values of a user's known country. We prompt different LLMs with a series of advice requests based on 5 Hofstede Cultural Dimensions -- a quantifiable way of representing the values of a country. Throughout each prompt, we incorporate personas representing 36 different countries and, separately, languages predominantly tied to each country to analyze the consistency in the LLMs' cultural understanding. Through our analysis of the responses, we found that LLMs can differentiate between one side of a value and another, as well as understand that countries have differing values, but will not always uphold the values when giving advice, and fail to understand the need to answer differently based on different cultural values. Rooted in these findings, we present recommendations for training value-aligned and culturally sensitive LLMs. More importantly, the methodology and the framework developed here can help further understand and mitigate culture and language alignment issues with LLMs.

Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). Builds on 25 of its 75 references that are in the map. First posted on arXiv 21 Jun 2024.

Builds on

25 of 75 references.

References · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
  5. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  6. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  7. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  8. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  9. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
  10. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  11. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
  12. 2018Scalable agent alignment via reward modeling: a research directioncited by 447
13 more
  1. 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
  2. 2023Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMscited by 104
  3. 2023Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experimentcited by 77
  4. 2024(A)I Am Not a Lawyer, But...: Engaging Legal Experts towards Responsible LLM Policies for Legal Advicecited by 63
  5. 2024From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examplescited by 57
  6. 2024Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages?cited by 24
  7. 2022Investigations of Performance and Bias in Human-AI Teamwork in Hiringcited by 16
  8. 2022On the Role of Negative Precedent in Legal Outcome Predictioncited by 16
  9. 2024Exploring and steering the moral compass of Large Language Modelscited by 16
  10. 2024Extending Llama-3's Context Ten-Fold Overnightcited by 15
  11. 2023Large Language Models as Corporate Lobbyistscited by 13
  12. 2023Bringing order into the realm of Transformer-based language models for artificial intelligence and lawcited by 13
  13. 2023Powering an AI Chatbot with Expert Sourcing to Support Credible Health Information Accesscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 6; 2025: 33; 2026: 13.

52 papers.

Sort:

By area:

  1. 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 51
  2. 2024LLM-GLOBE: A Benchmark Evaluating the Cultural Values Embedded in LLM Outputcited by 27
  3. 2025Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMscited by 26
  4. 2025Multiple LLM Agents Debate for Equitable Cultural Alignmentcited by 21
  5. 2024A Survey on Human-Centric LLMscited by 13
  6. 2025DRISHTIKON: A Multimodal Multilingual Benchmark for Testing Language Models' Understanding on Indian Culturecited by 13
  7. 2025ValuesRAG: Enhancing Cultural Alignment Through Retrieval-Augmented Contextual Learningcited by 10
  8. 2025Do Psychometric Tests Work for Large Language Models? Evaluation of Tests on Sexism, Racism, and Moralitycited by 9
  9. 2024Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and Englishcited by 8
  10. 2025An Investigation into Value Misalignment in LLM-Generated Texts for Cultural Heritagecited by 8
  11. 2025Meta-Cultural Competence: Climbing the Right Hill of Cultural Awarenesscited by 8
  12. 2025SaudiCulture: A Benchmark for Evaluating Large Language Models Cultural Competence within Saudi Arabiacited by 8
38 more
  1. 2024Cultural Fidelity in Large-Language Models: An Evaluation of Online Language Resources as a Driver of Model Performance in Value Representationcited by 7
  2. 2025Unequal Opportunities: Examining the Bias in Geographical Recommendations by Large Language Modelscited by 7
  3. 2026Knowing But Not Doing: Convergent Morality and Divergent Action in LLMscited by 7
  4. 2025Position: LLMs Can be Good Tutors in English Educationcited by 6
  5. 2025CAReDiO: Cultural Alignment via Representativeness and Distinctiveness Guided Data Optimizationcited by 6
  6. 2025EvalMORAAL: Interpretable Chain-of-Thought and LLM-as-Judge Evaluation for Moral Alignment in Large Language Modelscited by 6
  7. 2025Evaluating LLM Adaptation to Sociodemographic Factors: User Profile vs. Dialogue Historycited by 5
  8. 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 5
  9. 2025Do Large Language Models Understand Morality Across Cultures?cited by 5
  10. 2025Culturally-Aware Conversations: A Framework & Benchmark for LLMscited by 5
  11. 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
  12. 2025Through the Prism of Culture: Evaluating LLMs' Understanding of Indian Subcultures and Traditionscited by 4
  13. 2025AI Propaganda factories with language modelscited by 4
  14. 2025RoleConflictBench: A Benchmark of Role Conflict Scenarios for Evaluating LLMs' Contextual Sensitivitycited by 4
  15. 2025Identity-Aware Large Language Models require Cultural Reasoningcited by 4
  16. 2024Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipinocited by 3
  17. 2024LLMs as mirrors of societal moral standards: reflection of cultural divergence and agreement across ethical topicscited by 3
  18. 2025What are Foundation Models Cooking in the Post-Soviet World?cited by 3
  19. 2025Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Cultural Intelligence with CQ-Benchcited by 3
  20. 2025Exploring Cultural Variations in Moral Judgments with Large Language Modelscited by 3
  21. 2025Law in Silico: Simulating Legal Society with LLM-Based Agentscited by 3
  22. 2026XCR-Bench: Benchmarking Cross-Cultural Reasoning in LLMs via Culture-Specific Items and Hall's Triadcited by 3
  23. 2026Measuring Opinion Bias and Sycophancy via LLM-based Persuasioncited by 3
  24. 2025Reproducibility Study of "Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents"cited by 2
  25. 2025A Game-Theoretic Negotiation Framework for Cross-Cultural Consensus in LLMscited by 2
  26. 2025Somatic in the East, Psychological in the West?: Investigating Clinically-Grounded Cross-Cultural Depression Symptom Expression in LLMscited by 2
  27. 2025Linear socio-demographic representations emerge in Large Language Models from indirect cuescited by 2
  28. 2026A Unified Framework to Quantify Cultural Intelligence of AIcited by 2
  29. 2025A Cross-Cultural Comparison of LLM-based Public Opinion Simulation: Evaluating Chinese and U.S. Models on Diverse Societiescited by 1
  30. 2026Value Alignment Tax: Measuring Value Trade-offs in LLM Alignmentcited by 1
  31. 2026Improving Cross-Cultural Survey Simulation with Calibrated Value Personascited by 1
  32. 2026Accurate in space, unreliable in time: how LLMs represent national cultural changecited by 1
  33. 2025Analyzing Cognitive Differences Among Large Language Models through the Lens of Social Worldviewcited by 0
  34. 2025Designing LLMs for cultural sensitivity: Evidence from English-Japanese translationcited by 0
  35. 2026Initial Risk Probing and Feasibility Testing of Glow: a Generative AI-Powered Dialectical Behavior Therapy Skills Coach for Substance Use Recovery and HIV Preventioncited by 0
  36. 2026On the Cultural Anachronism and Temporal Reasoning in Vision Language Modelscited by 0
  37. 2026The "Knowledge-Behavior Gap" in Cultural Taboo Safety of Large Language Modelscited by 0
  38. 2026Beyond Cultural Knowledge: Evaluating Arabic Cultural Appropriateness of Large Language Modelscited by 0

50 most cited of 52 All 52 (JSON)