mlsanityData to 14 Oct 2026

From Word to World: Evaluate and Mitigate Culture Bias in LLMs via Word Association Test

arXiv 2505.18562 ↗First posted 24 May 2025cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

The human-centered word association test (WAT) serves as a cognitive proxy, revealing sociocultural variations through culturally shared semantic expectations and implicit linguistic patterns shaped by lived experiences. We extend this test into an LLM-adaptive, free-relation task to assess the alignment of large language models (LLMs) with cross-cultural cognition. To address culture preference, we propose CultureSteer, an innovative approach that moves beyond superficial cultural prompting by embedding cultural-specific semantic associations directly within the model's internal representation space. Experiments show that current LLMs exhibit significant bias toward Western (notably American) schemas at the word association level. In contrast, our model substantially improves cross-cultural alignment, capturing diverse semantic associations. Further validation on culture-sensitive downstream tasks confirms its efficacy in fostering cognitive alignment across cultures. This work contributes a novel methodological paradigm for enhancing cultural awareness in LLMs, advancing the development of more inclusive language technologies.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 50 references that are in the map. First posted on arXiv 24 May 2025.

Builds on

27 of 50 references.

References · 27

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  3. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
  4. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 377
  5. 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 273
  6. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 206
  7. 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 173
  8. 2024Investigating Cultural Alignment of Large Language Modelscited by 143
  9. 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 118
  10. 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
  11. 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
  12. 2023Word Embeddings Are Steers for Language Modelscited by 70
15 more
  1. 2023Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMscited by 64
  2. 2022Democratizing Neural Machine Translation with OPUS-MTcited by 58
  3. 2025Specializing Large Language Models to Simulate Survey Response Distributions for Global Populationscited by 53
  4. 2024Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsensecited by 51
  5. 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
  6. 2023Assessing LLMs for Moral Value Pluralismcited by 34
  7. 2024Can Language Models Reason about Individualistic Human Values and Preferences?cited by 34
  8. 2024Self-Pluralising Culture Alignment for Large Language Modelscited by 31
  9. 2024Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledgecited by 29
  10. 2024Self-Alignment: Improving Alignment of Cultural Values in LLMs via In-Context Learningcited by 19
  11. 2024MuLan: A Study of Fact Mutability in Language Modelscited by 10
  12. 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?cited by 10
  13. 2025Effectively Steer LLM To Follow Preference via Building Confident Directionscited by 7
  14. 2025CAReDiO: Cultural Alignment via Representativeness and Distinctiveness Guided Data Optimizationcited by 6
  15. 2025What Does a Software Engineer Look Like? Exploring Societal Stereotypes in LLMscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Aligned but Flattened: Analyzing the Trade-off between Cultural Alignment and Diversity in LLMs
  2. 2025Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs
  3. 2023CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models
  4. 2025Randomness, Not Representation: The Unreliability of Evaluating Cultural Alignment in LLMs
  5. 2025Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs
  6. 2026XCR-Bench: Benchmarking Cross-Cultural Reasoning in LLMs via Culture-Specific Items and Hall's Triad
  7. 2026Mind the Gap in Cultural Alignment: Task-Aware Culture Management for Large Language Models
  8. 2026AlignCultura: Towards Culturally Aligned Large Language Models?