mlsanityData to 14 Oct 2026

Fluent but Foreign: Even Regional LLMs Lack Cultural Alignment

arXiv 2505.21548 ↗First posted 25 May 2025cs.CL cs.AI cs.CYcited by 10

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are used worldwide, yet exhibit Western cultural tendencies. Many countries are now building ``regional'' or ``sovereign'' LLMs, but it remains unclear whether they reflect local values and practices or merely speak local languages. Using India as a case study, we evaluate six Indic and six global LLMs on two dimensions -- values and practices -- grounded in nationally representative surveys and community-sourced QA datasets. Across tasks, Indic models do not align better with Indian norms than global models; in fact, a U.S. respondent is a closer proxy for Indian values than any Indic model. We further run a user study with 115 Indian users and find that writing suggestions from both global and Indic LLMs introduce Westernized or exoticized writing. Prompting and regional fine-tuning fail to recover alignment and can even degrade existing knowledge. We attribute this to scarce culturally grounded data, especially for pretraining. We position cultural evaluation as a first-class requirement alongside multilingual benchmarks and offer a reusable, community-grounded methodology. We call for native, community-authored corpora and thickxwide evaluations to build truly sovereign LLMs.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 25 May 2025.

Builds on

21 of 42 references.

References · 21

  1. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
  2. 2023MEGA: Multilingual Evaluation of Generative AIcited by 293
  3. 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
  4. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 206
  5. 2024A Roadmap to Pluralistic Alignmentcited by 184
  6. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
  7. 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 149
  8. 2024The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinismcited by 116
  9. 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
  10. 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
  11. 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 104
  12. 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 60
9 more
  1. 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
  2. 2023Multilingual Language Models are not Multicultural: A Case Study in Emotioncited by 54
  3. 2025Randomness, Not Representation: The Unreliability of Evaluating Cultural Alignment in LLMscited by 54
  4. 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 51
  5. 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 48
  6. 2024Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Promptingcited by 22
  7. 2025The Case for "Thick Evaluations" of Cultural Representation in AIcited by 17
  8. 2025Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindicited by 10
  9. 2025Meta-Cultural Competence: Climbing the Right Hill of Cultural Awarenesscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs
  2. 2025An Evaluation of Cultural Value Alignment in LLM
  3. 2023CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models
  4. 2025Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs
  5. 2026Understanding Cultural Alignment in Multilingual LLMs via Natural Debate Statements ↗
  6. 2024Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and English
  7. 2026Mind the Gap: Pitfalls of LLM Alignment with Asian Public Opinion
  8. 2024Navigating the Cultural Kaleidoscope: A Hitchhiker's Guide to Sensitivity in Large Language Models