mlsanityData to 14 Oct 2026

CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Prompting

arXiv 2404.10199 ↗First posted 16 Apr 2024cs.CL cs.AIcited by 55

Not on the map. Why?

Abstract (arXiv)

As the utilization of large language models (LLMs) has proliferated world-wide, it is crucial for them to have adequate knowledge and fair representation for diverse global cultures. In this work, we uncover culture perceptions of three SOTA models on 110 countries and regions on 8 culture-related topics through culture-conditioned generations, and extract symbols from these generations that are associated to each culture by the LLM. We discover that culture-conditioned generation consist of linguistic "markers" that distinguish marginalized cultures apart from default cultures. We also discover that LLMs have an uneven degree of diversity in the culture symbols, and that cultures from different geographic regions have different presence in LLMs' culture-agnostic generation. Our findings promote further research in studying the knowledge and fairness of global culture perception in LLMs. Code and Data can be found here: https://github.com/huihanlhh/Culture-Gen/

Key facts. Cited by 55 papers in the map (data through 14 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 16 Apr 2024.

Builds on

24 of 35 references.

References · 24

  1. 2019Language Models as Knowledge Bases?cited by 1,936
  2. 2024OLMo: Accelerating the Science of Language Modelscited by 613
  3. 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 483
  4. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
  5. 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
  6. 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 207
  7. 2024A Roadmap to Pluralistic Alignmentcited by 184
  8. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
  9. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  10. 2024Investigating Cultural Alignment of Large Language Modelscited by 143
  11. 2023What's In My Big Data?cited by 129
  12. 2022Extracting Cultural Commonsense Knowledge at Scalecited by 76
12 more
  1. 2024Unintended Impacts of LLM Alignment on Global Representationcited by 66
  2. 2024Massively Multi-Cultural Knowledge Acquisition & LM Benchmarkingcited by 63
  3. 2023NormBank: A Knowledge Bank of Situational Social Normscited by 60
  4. 2023Knowledge of cultural moral norms in large language modelscited by 51
  5. 2024CultureLLM: Incorporating Cultural Differences into Large Language Modelscited by 50
  6. 2023Evaluation of African American Language Bias in Natural Language Generationcited by 36
  7. 2023COPAL-ID: Indonesian Language Reasoning with Local Culture and Nuancescited by 35
  8. 2023EtiCor: Corpus for Analyzing LLMs for Etiquettescited by 33
  9. 2022GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Modelscited by 30
  10. 2023Global Voices, Local Biases: Socio-Cultural Prejudices across Languagescited by 23
  11. 2023DLAMA: A Framework for Curating Culturally Diverse Facts for Probing the Knowledge of Pretrained Language Modelscited by 17
  12. 2023What Do Llamas Really Think? Revealing Preference Biases in Language Model Representationscited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 14; 2025: 23; 2026: 18.

55 papers.

Sort:

By area:

  1. 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
  2. 2024Evaluating Cultural and Social Awareness of LLM Web Agentscited by 45
  3. 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
  4. 2024CaLMQA: Exploring culturally specific long-form question answering across 23 languagescited by 31
  5. 2024Beyond Aesthetics: Cultural Competence in Text-to-Image Modelscited by 30
  6. 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
  7. 2024Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Promptingcited by 22
  8. 2025Presumed Cultural Identity: How Names Shape LLM Responsescited by 21
  9. 2025Multiple LLM Agents Debate for Equitable Cultural Alignmentcited by 21
  10. 2024Multilingual Large Language Models: A Systematic Surveycited by 18
  11. 2025The Case for "Thick Evaluations" of Cultural Representation in AIcited by 17
  12. 2025SANSKRITI: A Comprehensive Benchmark for Evaluating Language Models' Knowledge of Indian Culturecited by 16
38 more
  1. 2025CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesiscited by 15
  2. 2025Biased Tales: Cultural and Topic Bias in Generating Children's Storiescited by 15
  3. 2025Diffusion Models Through a Global Lens: Are They Culturally Inclusive?cited by 14
  4. 2025Beyond Words: Exploring Cultural Value Sensitivity in Multimodal Modelscited by 14
  5. 2025Igniting Creative Writing in Small Language Models: LLM-as-a-Judge versus Multi-Agent Refined Rewardscited by 11
  6. 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.Scited by 9
  7. 2024CVLUE: A New Benchmark Dataset for Chinese Vision-Language Understanding Evaluationcited by 8
  8. 2024Attributing Culture-Conditioned Generations to Pretraining Corporacited by 8
  9. 2025Meta-Cultural Competence: Climbing the Right Hill of Cultural Awarenesscited by 8
  10. 2025Steerable Pluralism: Pluralistic Alignment via Few-Shot Comparative Regressioncited by 7
  11. 2026Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responsescited by 6
  12. 2024"A Woman is More Culturally Knowledgeable than A Man?": The Effect of Personas on Cultural Norm Interpretation in LLMscited by 5
  13. 2025Cross-Lingual Transfer of Cultural Knowledge: An Asymmetric Phenomenoncited by 5
  14. 2025To Mask or to Mirror: Human-AI Alignment in Collective Reasoningcited by 5
  15. 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
  16. 2024Navigating the Cultural Kaleidoscope: A Hitchhiker's Guide to Sensitivity in Large Language Modelscited by 4
  17. 2024KAHANI: Culturally-Nuanced Visual Storytelling Tool for Non-Western Culturescited by 4
  18. 2025Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoningcited by 4
  19. 2025Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Cultural Intelligence with CQ-Benchcited by 3
  20. 2025MCEval: A Dynamic Framework for Fair Multilingual Cultural Evaluation of LLMscited by 3
  21. 2025Let's Play Across Cultures: A Large Multilingual, Multicultural Benchmark for Assessing Language Models' Understanding of Sportscited by 3
  22. 2025User Behavior Prediction as a Generic, Robust, Scalable, and Low-Cost Evaluation Strategy for Estimating Generalization in LLMscited by 2
  23. 2026CALM: Culturally Self-Aware Language Modelscited by 2
  24. 2026Reward Shaping for (Inference-Time) Alignment: A Stackelberg Game Perspectivecited by 2
  25. 2026A Unified Framework to Quantify Cultural Intelligence of AIcited by 2
  26. 2026Representational Harms in LLM-Generated Narratives Against Global Majority Nationalitiescited by 2
  27. 2024LoFTI: Localization and Factuality Transfer to Indian Localescited by 1
  28. 2025MEDAL: A Framework for Benchmarking LLMs as Multilingual Open-Domain Dialogue Evaluatorscited by 1
  29. 2026Mitigating Cultural Bias in LLMs via Multi-Agent Cultural Debatecited by 1
  30. 2026When Cultures Move: Measuring and Improving Multicultural Text-to-Video Generationcited by 1
  31. 2026Steerable Cultural Preference Optimization of Reward Modelscited by 1
  32. 2025Bridging AI and Carbon Capture: A Dataset for LLMs in Ionic Liquids and CBE Researchcited by 0
  33. 2025Language over Content: Tracing Cultural Understanding in Multilingual Large Language Modelscited by 0
  34. 2026To Generate or Discriminate? Methodological Considerations for Measuring Cultural Alignment in LLMscited by 0
  35. 2026PPCR-IM: A System for Multi-layer DAG-based Public Policy Consequence Reasoning and Social Indicator Mappingcited by 0
  36. 2026DRInQ: Evaluating Conversational Implicature with Controlled Context Variationcited by 0
  37. 2026Implicit Geographic Inference in LLM Medical Triage: Language-Driven Disparities in Emergency Recommendationscited by 0
  38. 2026Who Brought Easter Eggs to Eid? Auditing LLM-Generated Cultural Translation of Math Word Problems Across Languages and Regionscited by 0

50 most cited of 55 All 55 (JSON)