mlsanityData to 14 Oct 2026

CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems

arXiv 2609.22494 ↗First posted 18 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In recent years, there has been a surge of interest in Cultural NLP, with substantial efforts to create globally inclusive NLP systems. The rapid growth of literature in this field makes it difficult to track trends in methods and data resources. To address this, we analyze over 375 papers to answer three complementary questions: (1) What Cultural Capabilities (CCs) are being targeted in NLP systems? (2) How are cultural data resources being created? and (3) What methods are being used to improve the CCs of those systems? We discuss trends observed across the three questions, and identify relevant research gaps. To facilitate further research in this field, we release our full list of analyzed papers in the form of an interactive web interface, which includes a feature to allow researchers to add their work; we hope this facilitates future research and proves to be a valuable resource for the Cultural NLP community.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 221 of its 378 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

221 of 378 references.

References · 221

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023Large Language Modelscited by 780
  3. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 372
  4. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 206
  5. 2021Visually Grounded Reasoning across Languages and Culturescited by 189
  6. 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
  7. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  8. 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 149
  9. 2024Investigating Cultural Alignment of Large Language Modelscited by 143
  10. 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 115
  11. 2024Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaborationcited by 113
  12. 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
38 more
  1. 2023SeaLLMs -- Large Language Models for Southeast Asiacited by 104
  2. 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
  3. 2020GLUECoS : An Evaluation Benchmark for Code-Switched NLPcited by 102
  4. 2024Benchmarking Vision Language Models for Cultural Understandingcited by 101
  5. 2024CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologiescited by 98
  6. 2023SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoningcited by 94
  7. 2024KMMLU: Measuring Massive Multitask Language Understanding in Koreancited by 91
  8. 2023AceGPT, Localizing Large Language Models in Arabiccited by 75
  9. 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harmcited by 70
  10. 2023SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Modelscited by 66
  11. 2024CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Koreancited by 66
  12. 2023NormBank: A Knowledge Bank of Situational Social Normscited by 60
  13. 2024WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Modelscited by 60
  14. 2021Broaden the Vision: Geo-Diverse Visual Commonsense Reasoningcited by 59
  15. 2023Multilingual Language Models are not Multicultural: A Case Study in Emotioncited by 54
  16. 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
  17. 2023Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLUcited by 53
  18. 2025Specializing Large Language Models to Simulate Survey Response Distributions for Global Populationscited by 53
  19. 2024Understanding the Capabilities and Limitations of Large Language Models for Cultural Commonsensecited by 51
  20. 2025Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values?cited by 51
  21. 2023Value FULCRA: Mapping Large Language Models to the Multidimensional Spectrum of Basic Human Valuescited by 50
  22. 2022NormSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Flycited by 48
  23. 2023Multi-lingual and Multi-cultural Figurative Language Understandingcited by 47
  24. 2023HAE-RAE Bench: Evaluation of Korean Knowledge in Language Modelscited by 47
  25. 2024Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language we Prompt them incited by 46
  26. 2024AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMscited by 46
  27. 2022Exploring Document-Level Literary Machine Translation with Parallel Paragraphs from World Literaturecited by 45
  28. 2023Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysiscited by 45
  29. 2024Evaluating Cultural and Social Awareness of LLM Web Agentscited by 45
  30. 2024SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languagescited by 43
  31. 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
  32. 2024IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provincescited by 39
  33. 2024WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisinescited by 39
  34. 2024PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Datacited by 37
  35. 2024Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and Sundanesecited by 36
  36. 2024An image speaks a thousand words, but can everyone listen? On image transcreation for cultural relevancecited by 36
  37. 2023COPAL-ID: Indonesian Language Reasoning with Local Culture and Nuancescited by 35
  38. 2024Can Language Models Reason about Individualistic Human Values and Preferences?cited by 34

50 most cited of 221 All 221 (JSON)

Built on by

Not cited yet.