Fluent but Foreign: Even Regional LLMs Lack Cultural Alignment
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are used worldwide, yet exhibit Western cultural tendencies. Many countries are now building ``regional'' or ``sovereign'' LLMs, but it remains unclear whether they reflect local values and practices or merely speak local languages. Using India as a case study, we evaluate six Indic and six global LLMs on two dimensions -- values and practices -- grounded in nationally representative surveys and community-sourced QA datasets. Across tasks, Indic models do not align better with Indian norms than global models; in fact, a U.S. respondent is a closer proxy for Indian values than any Indic model. We further run a user study with 115 Indian users and find that writing suggestions from both global and Indic LLMs introduce Westernized or exoticized writing. Prompting and regional fine-tuning fail to recover alignment and can even degrade existing knowledge. We attribute this to scarce culturally grounded data, especially for pretraining. We position cultural evaluation as a first-class requirement alongside multilingual benchmarks and offer a reusable, community-grounded methodology. We call for native, community-authored corpora and thickxwide evaluations to build truly sovereign LLMs.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 25 May 2025.
Builds on
21 of 42 references.
References · 21
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
- 2023MEGA: Multilingual Evaluation of Generative AIcited by 293
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
- 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 206
- 2024A Roadmap to Pluralistic Alignmentcited by 184
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
- 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 149
- 2024The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinismcited by 116
- 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
- 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
- 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 104
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 60
9 more
- 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
- 2023Multilingual Language Models are not Multicultural: A Case Study in Emotioncited by 54
- 2025Randomness, Not Representation: The Unreliability of Evaluating Cultural Alignment in LLMscited by 54
- 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 51
- 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 48
- 2024Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Promptingcited by 22
- 2025The Case for "Thick Evaluations" of Cultural Representation in AIcited by 17
- 2025Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindicited by 10
- 2025Meta-Cultural Competence: Climbing the Right Hill of Cultural Awarenesscited by 8
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026The Culture Funnel: You Can't Align What isn't in the Datacited by 2
- 2026Assessing the Pedagogical Readiness of Large Language Models as AI Tutors in Low-Resource Contexts: A Case Study of Nepal's K-10 Curriculumcited by 1
- 2026AI-Assisted Systematization for Evaluating GenAI Systemscited by 1
- 2026Benchmarking Frontier LLMs on Arabic Cultural and Sociolinguistic Knowledge: A Cross-Evaluation Framework with Human SME Ground Truthcited by 1
- 2026PLURAL: A Global Dataset for Value Alignmentcited by 1
- 2026NarrativeWorldBench: A Frontier-Saturated Benchmark and a Latent World Model for Long-Horizon Co-Creative Audio Dramacited by 0
- 2026Rethinking Indic AI from a Lens of Cultural Heritage Preservationcited by 0
- 2026Same violence, different answer: how AI responds to coercive control against women across languagescited by 0
- 2026Computational Orientalism: Measuring Structural Discourse Bias in Large Language Models Using the Middle East Cultural Sensitivity Score (MECSS)cited by 0
- 2026Toward Cultural Alignment: Human-Centered Evaluation of Multimodal AI Stories Across Five African Communitiescited by 0
- 2026Toward Cultural Alignment: Human-Centered Evaluation of Multimodal AI Stories Across Five African Communities29 Aug 2026
- 2026Same violence, different answer: how AI responds to coercive control against women across languages2 Aug 2026
- 2026PLURAL: A Global Dataset for Value Alignment9 Jul 2026
- 2026Rethinking Indic AI from a Lens of Cultural Heritage Preservation7 Jul 2026
- 2026Benchmarking Frontier LLMs on Arabic Cultural and Sociolinguistic Knowledge: A Cross-Evaluation Framework with Human SME Ground Truth30 Jun 2026
- 2026NarrativeWorldBench: A Frontier-Saturated Benchmark and a Latent World Model for Long-Horizon Co-Creative Audio Drama16 Jun 2026
- 2026The Culture Funnel: You Can't Align What isn't in the Data11 Jun 2026
- 2026Computational Orientalism: Measuring Structural Discourse Bias in Large Language Models Using the Middle East Cultural Sensitivity Score (MECSS)9 Jun 2026
- 2026AI-Assisted Systematization for Evaluating GenAI Systems25 May 2026
- 2026Assessing the Pedagogical Readiness of Large Language Models as AI Tutors in Low-Resource Contexts: A Case Study of Nepal's K-10 Curriculum17 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs
- 2025An Evaluation of Cultural Value Alignment in LLM
- 2023CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models
- 2025Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs
- 2026Understanding Cultural Alignment in Multilingual LLMs via Natural Debate Statements ↗
- 2024Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and English
- 2026Mind the Gap: Pitfalls of LLM Alignment with Asian Public Opinion
- 2024Navigating the Cultural Kaleidoscope: A Hitchhiker's Guide to Sensitivity in Large Language Models