mlsanityData to 7 Oct 2026

CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies

arXiv 2404.15238 ↗First posted 23 Apr 2024cs.CL cs.AIcited by 98

Not on the map. Why?

Abstract (arXiv)

To enhance language models' cultural awareness, we design a generalizable pipeline to construct cultural knowledge bases from different online communities on a massive scale. With the pipeline, we construct CultureBank, a knowledge base built upon users' self-narratives with 12K cultural descriptors sourced from TikTok and 11K from Reddit. Unlike previous cultural knowledge resources, CultureBank contains diverse views on cultural descriptors to allow flexible interpretation of cultural knowledge, and contextualized cultural scenarios to help grounded evaluation. With CultureBank, we evaluate different LLMs' cultural awareness, and identify areas for improvement. We also fine-tune a language model on CultureBank: experiments show that it achieves better performances on two downstream cultural tasks in a zero-shot setting. Finally, we offer recommendations based on our findings for future culturally aware language technologies. The project page is https://culturebank.github.io . The code and model is at https://github.com/SALT-NLP/CultureBank . The released CultureBank dataset is at https://huggingface.co/datasets/SALT-NLP/CultureBank .

Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). Builds on 28 of its 71 references that are in the map. First posted on arXiv 23 Apr 2024.

Builds on

28 of 71 references.

References · 28

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  7. 2024Mixtral of Expertscited by 1,785
  8. 2023Whose Opinions Do Language Models Reflect?cited by 759
  9. 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
  10. 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
  11. 2021Visually Grounded Reasoning across Languages and Culturescited by 188
  12. 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 188
16 more
  1. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  2. 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 147
  3. 2020X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Modelscited by 117
  4. 2022Extracting Cultural Commonsense Knowledge at Scalecited by 76
  5. 2023KoBBQ: Korean Bias Benchmark for Question Answeringcited by 71
  6. 2023GPT4GEO: How a Language Model Sees the World's Geographycited by 68
  7. 2024Unintended Impacts of LLM Alignment on Global Representationcited by 66
  8. 2024CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Koreancited by 65
  9. 2024Massively Multi-Cultural Knowledge Acquisition & LM Benchmarkingcited by 63
  10. 2023NormBank: A Knowledge Bank of Situational Social Normscited by 60
  11. 2023Automating Customer Service using LangChain: Building custom open-source GPT Chatbot for organizationscited by 59
  12. 2023Knowledge of cultural moral norms in large language modelscited by 51
  13. 2024Can LLM Generate Culturally Relevant Commonsense QA Data? Case Study in Indonesian and Sundanesecited by 36
  14. 2022GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Modelscited by 30
  15. 2022StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypescited by 14
  16. 2020Dialogue-Based Simulation For Cultural Awareness Trainingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 20; 2025: 38; 2026: 40.

98 papers.

Sort:

By area:

  1. 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 171
  2. 2024Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaborationcited by 111
  3. 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 101
  4. 2024INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledgecited by 78
  5. 2024Bias in Large Language Models: Origin, Evaluation, and Mitigationcited by 77
  6. 2024Language Model Alignment in Multilingual Trolley Problemscited by 46
  7. 2024Evaluating Cultural and Social Awareness of LLM Web Agentscited by 43
  8. 2025CultureVLM: Characterizing and Improving Cultural Understanding of Vision-Language Models for over 100 Countriescited by 40
  9. 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
  10. 2024Can Language Models Reason about Individualistic Human Values and Preferences?cited by 34
  11. 2025Privacy in Action: Towards Realistic Privacy Mitigation and Evaluation for LLM-Powered Agentscited by 33
  12. 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
38 more
  1. 2025When One LLM Drools, Multi-LLM Collaboration Rulescited by 25
  2. 2024CulturePark: Boosting Cross-cultural Understanding in Large Language Modelscited by 24
  3. 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
  4. 2025Multiple LLM Agents Debate for Equitable Cultural Alignmentcited by 20
  5. 2024Multilingual Large Language Models: A Systematic Surveycited by 18
  6. 2025Valid Survey Simulations with Limited Human Data: The Roles of Prompting, Fine-Tuning, and Rectificationcited by 17
  7. 2025Palm: A Culturally Inclusive and Linguistically Diverse Dataset for Arabic LLMscited by 15
  8. 2024Cultural Palette: Pluralising Culture Alignment via Multi-agent Palettecited by 14
  9. 2025MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMscited by 13
  10. 2024mCSQA: Multilingual Commonsense Reasoning Dataset with Unified Creation Strategy by Language Models and Humanscited by 10
  11. 2024SafeWorld: Geo-Diverse Safety Alignmentcited by 10
  12. 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Storiescited by 10
  13. 2024Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the U.Scited by 9
  14. 2024The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioningcited by 9
  15. 2025What do Large Language Models Say About Animals? Investigating Risks of Animal Harm in Generated Textcited by 9
  16. 2024Vision-Language Models under Cultural and Inclusive Considerationscited by 8
  17. 2025SaudiCulture: A Benchmark for Evaluating Large Language Models Cultural Competence within Saudi Arabiacited by 8
  18. 2025Multimodal Cultural Safety: Evaluation Framework and Alignment Strategiescited by 8
  19. 2025SPARTA ALIGNMENT: Collectively Aligning Multiple Language Models through Combatcited by 8
  20. 2025STEER-BENCH: A Benchmark for Evaluating the Steerability of Large Language Modelscited by 6
  21. 2025We Politely Insist: Your LLM Must Learn the Persian Art of Taarofcited by 6
  22. 2025CURE: Cultural Understanding and Reasoning Evaluation - A Framework for "Thick" Culture Alignment Evaluation in LLMscited by 6
  23. 2026Tears or Cheers? Benchmarking LLMs via Culturally Elicited Distinct Affective Responsescited by 6
  24. 2025CAReDiO: Cultural Alignment via Representativeness and Distinctiveness Guided Data Optimizationcited by 5
  25. 2025Culturally-Aware Conversations: A Framework & Benchmark for LLMscited by 5
  26. 2025Counterfactual Reasoning for Steerable Pluralistic Value Alignment of Large Language Modelscited by 5
  27. 2024Navigating the Cultural Kaleidoscope: A Hitchhiker's Guide to Sensitivity in Large Language Modelscited by 4
  28. 2025FedMerge: Federated Personalization via Model Mergingcited by 4
  29. 2025EnDive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Modelscited by 4
  30. 2025Isolating Culture Neurons in Multilingual Large Language Modelscited by 4
  31. 2025One Model, Many Morals: Uncovering Cross-Linguistic Misalignments in Computational Moral Reasoningcited by 4
  32. 2025VideoNorms: Benchmarking Cultural Awareness of Video Language Modelscited by 4
  33. 2025Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Cultural Intelligence with CQ-Benchcited by 3
  34. 2025BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluationcited by 3
  35. 2025MCEval: A Dynamic Framework for Fair Multilingual Cultural Evaluation of LLMscited by 3
  36. 2026Common to Whom? Regional Cultural Commonsense and LLM Bias in Indiacited by 3
  37. 2026Mind the Gap in Cultural Alignment: Task-Aware Culture Management for Large Language Modelscited by 3
  38. 2025From Word to World: Evaluate and Mitigate Culture Bias in LLMs via Word Association Testcited by 2

50 most cited of 98 All 98 (JSON)