Challenges and Strategies in Cross-Cultural NLP
Not on the map. Why?
Abstract (arXiv)
Various efforts in the Natural Language Processing (NLP) community have been made to accommodate linguistic diversity and serve speakers of many different languages. However, it is important to acknowledge that speakers and the content they produce and require, vary not just by language, but also by culture. Although language and culture are tightly linked, there are important differences. Analogous to cross-lingual and multilingual NLP, cross-cultural and multicultural NLP considers these differences in order to better serve users of NLP systems. We propose a principled framework to frame these efforts, and survey existing and potential strategies.
Key facts. Cited by 216 papers in the map (data through 7 Oct 2026). Builds on 68 of its 168 references that are in the map. First posted on arXiv 18 Mar 2022.
Builds on
68 of 168 references.
References · 68
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
- 2019Cross-lingual Language Model Pretrainingcited by 1,088
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
- 2020The State and Fate of Linguistic Diversity and Inclusion in the NLP Worldcited by 789
- 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
38 more
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 363
- 2020AraBERT: Transformer-based Model for Arabic Language Understandingcited by 359
- 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 330
- 2021Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotationscited by 306
- 2019Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERTcited by 301
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
- 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 269
- 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 246
- 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 222
- 2020XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generationcited by 221
- 2019Gender Bias in Contextualized Word Embeddingscited by 203
- 2021Visually Grounded Reasoning across Languages and Culturescited by 188
- 2020Large-Scale Methods for Distributionally Robust Optimizationcited by 179
- 2021Process for Adapting Language Models to Society (PALMS) with Values-Targeted Datasetscited by 179
- 2021XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluationcited by 167
- 2021MasakhaNER: Named Entity Recognition for African Languagescited by 155
- 2019Distributionally Robust Language Modelingcited by 142
- 2021Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Modelscited by 132
- 2019The Ethics of AI Ethics -- An Evaluation of Guidelinescited by 129
- 2018Style Transfer Through Back-Translationcited by 124
- 2021On Releasing Annotator-Level Labels and Information in Datasetscited by 123
- 2019Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learningcited by 116
- 2022Jury Learning: Integrating Dissenting Voices into Machine Learning Modelscited by 115
- 2020Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligencecited by 100
- 2021Algorithmic Monoculture and Social Welfarecited by 98
- 2017Racial Disparity in Natural Language Processing: A Case Study of Social Media African-American Englishcited by 69
- 2020An Information Bottleneck Approach for Controlling Conciseness in Rationale Extractioncited by 69
- 2019Garbage In, Garbage Out? Do Machine Learning Application Papers in Social Computing Report Where Human-Labeled Training Data Comes From?cited by 64
- 2021Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoningcited by 64
- 2018On the Limitations of Unsupervised Bilingual Dictionary Inductioncited by 61
- 2021Broaden the Vision: Geo-Diverse Visual Commonsense Reasoningcited by 59
- 2017Shakespearizing Modern Language Using Copy-Enriched Sequence-to-Sequence Modelscited by 57
- 2020Hooks in the Headline: Learning to Generate Headlines with Controlled Stylescited by 46
- 2021COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentencescited by 40
- 2020Towards an Atlas of Cultural Commonsense for Machine Reasoningcited by 28
- 2016Massively Multilingual Word Embeddingscited by 26
- 2021Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfercited by 23
- 2021A Word on Machine Ethics: A Response to Jiang et al. (2021)cited by 23
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2022: 11; 2023: 35; 2024: 61; 2025: 56; 2026: 53.
216 papers.
Sort:
By area:
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
- 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
- 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 171
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
- 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 147
- 2022The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluationcited by 133
- 2024Benchmarking Vision Language Models for Cultural Understandingcited by 100
- 2023Language Model Behavior: A Comprehensive Surveycited by 92
- 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2023AceGPT, Localizing Large Language Models in Arabiccited by 75
38 more
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignmentcited by 71
- 2023BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfercited by 68
- 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harmcited by 67
- 2023SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Modelscited by 66
- 2024Massively Multi-Cultural Knowledge Acquisition & LM Benchmarkingcited by 63
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 59
- 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
- 2022Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Modelscited by 49
- 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
- 2023Multi-lingual and Multi-cultural Figurative Language Understandingcited by 47
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
- 2024IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provincescited by 38
- 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 36
- 2022Speaking Multiple Languages Affects the Moral Bias of Language Modelscited by 34
- 2023Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayingscited by 32
- 2024CaLMQA: Exploring culturally specific long-form question answering across 23 languagescited by 31
- 2024Self-Pluralising Culture Alignment for Large Language Modelscited by 31
- 2024Beyond Aesthetics: Cultural Competence in Text-to-Image Modelscited by 30
- 2024CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledgecited by 28
- 2024CulturalBench: A Robust, Diverse, and Challenging Cultural Benchmark by Human-AI CulturalTeamingcited by 27
- 2025BRIGHTER: BRIdging the Gap in Human-Annotated Textual Emotion Recognition Datasets for 28 Languagescited by 27
- 2023Ethical Considerations for Machine Translation of Indigenous Languages: Giving a Voice to the Speakerscited by 26
- 2023Disentangling Perceptions of Offensiveness: Cultural and Moral Correlatescited by 26
- 2024Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignmentcited by 26
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2025Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMscited by 26
- 2022Beyond Counting Datasets: A Survey of Multilingual Dataset Construction and Necessary Resourcescited by 25
- 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
- 2024Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages?cited by 23
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subculturescited by 23
- 2023What's the Meaning of Superhuman Performance in Today's NLU?cited by 22
- 2022Cultural Incongruencies in Artificial Intelligencecited by 21
- 2023Cross-Cultural Transfer Learning for Chinese Offensive Language Detectioncited by 21
- 2024Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questionscited by 21
- 2024Towards Cross-Cultural Machine Translation with Retrieval-Augmented Generation from Multilingual Knowledge Graphscited by 21
- 2025From Calibration to Collaboration: LLM Uncertainty Quantification Should Be More Human-Centeredcited by 21
- 2023Modeling Cross-Cultural Pragmatic Inference with Codenames Duetcited by 20
- 2024The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Modelscited by 19
50 most cited of 216 All 216 (JSON)
- 2026Evaluating Cultural Awareness of LLMs for Haitian Creole25 Sep 2026
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026HerHealthEval: Evaluating Multilingual and Register-Sensitive Understanding of Women's Health Communication17 Sep 2026
- 2026Evaluating Communicative Success in Machine-Translated Conversation17 Sep 2026
- 2026Why Pretraining Fails to Share Cross-Lingual Knowledge16 Sep 2026
- 2026Multilingual in Name Only? Cultural and Linguistic Weaknesses of LLMs in Urdu9 Sep 2026
- 2026Perspectives on Cross-Lingual Consistency in LLMs for Medical Questions7 Sep 2026
- 2026Probing Factual Knowledge Transfer with Training Data Interventions1 Sep 2026
- 2026AtlasNLP: A Country-Aware Atlas of Dataset Representation in NLP31 Aug 2026
- 2026CoCoA: Context-Conditional Cultural Alignment for Large Language Models30 Aug 2026
- 2026Pad=artha: Ontology-Grounded Fine-Grained NER Benchmark for Classical Sanskrit29 Aug 2026
- 2026Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding27 Aug 2026
38 more
- 2026Beyond Surface Cues: Disentangling Sociocultural Signals in Multilingual LLMs24 Aug 2026
- 2026Investigating the Influence of Prompt and Response Languages on LLM Content Generation22 Aug 2026
- 2026PUMA: A Polish Benchmark for Culturally Grounded Multimodal Understanding22 Aug 2026
- 2026BavGround: A Benchmark for Regional Cultural Grounding and Dialect Competence in Bavarian13 Aug 2026
- 2026Cultural Awareness is Represented but Not Decoded: Tracing Mythological Knowledge across 18 Open-Source LLMs3 Aug 2026
- 2026Beyond Cultural Knowledge: Evaluating Arabic Cultural Appropriateness of Large Language Models30 Jul 2026
- 2026On the Systematic Challenges of Culturally Loaded Machine Translation: Dream of the Red Chamber as the Cultural Lens22 Jul 2026
- 2026Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability7 Jul 2026
- 2026MultiSynt/MT: Trillion-Token Multi-Parallel Pre-Training Data Translated Across 36 Languages1 Jul 2026
- 2026Benchmarking Frontier LLMs on Arabic Cultural and Sociolinguistic Knowledge: A Cross-Evaluation Framework with Human SME Ground Truth30 Jun 2026
- 2026LLMs Infer Cultural Context but Fail to Apply It When Responding16 Jun 2026
- 2026The Culture Funnel: You Can't Align What isn't in the Data11 Jun 2026
- 2026The Geometry of LLM-as-Judge: Why Inter-LLM Consensus Is Not Human Alignment2 Jun 2026
- 2026Supervised Semantic Differential for Cross-Cultural Concept Analysis: A Case Study of Human Affect27 May 2026
- 2026The Annotation Scarcity Paradox in Low-Resource NLP Evaluation: A Decade of Acceleration and Emerging Constraints18 May 2026
- 2026Infini-News: Efficiently Queryable Access to 1.3 Billion Processed Common Crawl News Articles18 May 2026
- 2026Defining Cultural Capabilities for AI Evaluation: A Taxonomy Grounded in Intercultural Communication Theory15 May 2026
- 2026Understanding Annotator Safety Policy with Interpretability6 May 2026
- 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues30 Apr 2026
- 2026CulturALL: Benchmarking Multilingual and Multicultural Competence of LLMs on Grounded Tasks21 Apr 2026
- 2026Cross-Cultural Value Attribution in Large Vision-Language Models10 Apr 2026
- 2026Signals Are Not States: Neuro-Symbolic Safeguards for Culturally Aware Classroom AI24 Mar 2026
- 2026SAGE: Sustainable Agent-Guided Expert-tuning for Culturally Attuned Translation in Low-Resource Southeast Asia20 Mar 2026
- 2026SommBench: Assessing Sommelier Expertise of Language Models12 Mar 2026
- 2026Counting on Consensus: Selecting the Right Inter-annotator Agreement Metric for NLP Annotation and Evaluation6 Mar 2026
- 2026InfoGatherer: Principled Information Seeking via Evidence Retrieval and Strategic Questioning6 Mar 2026
- 2026A Unified Framework to Quantify Cultural Intelligence of AI1 Mar 2026
- 2026Next Reply Prediction X Dataset: Linguistic Discrepancies in Naively Generated Content22 Feb 2026
- 2026MiSCHiEF: A Benchmark in Minimal-Pairs of Safety and Culture for Holistic Evaluation of Fine-Grained Image-Caption Alignment21 Feb 2026
- 2026Long-Tail Knowledge in Large Language Models: Taxonomy, Mechanisms, Interventions and Implications18 Feb 2026
- 2026Leveraging Wikidata for Geographically Informed Sociocultural Bias Dataset Creation: Application to Latin America16 Feb 2026
- 2026Can LLMs Cook Jamaican Couscous? A Study of Cultural Novelty in Recipe Generation11 Feb 2026
- 2026compar:IA: The French Government's LLM arena to collect French-language human prompts and preference data6 Feb 2026
- 2026DIVERGE: Diversity-Enhanced RAG for Open-Ended Information Seeking30 Jan 2026
- 2026Toward Culturally Aligned LLMs through Ontology-Guided Multi-Agent Reasoning29 Jan 2026
- 2026LLMs as Cultural Archives: Cultural Commonsense Knowledge Graph Extraction25 Jan 2026
- 2026Beyond Translation: Cross-Cultural Meme Transcreation with Vision-Language Models23 Jan 2026
- 2026XCR-Bench: Benchmarking Cross-Cultural Reasoning in LLMs via Culture-Specific Items and Hall's Triad20 Jan 2026
50 newest of 216 All 216 (JSON)
- 2023AceGPT, Localizing Large Language Models in Arabiccited by 75
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignmentcited by 71
- 2024Self-Pluralising Culture Alignment for Large Language Modelscited by 31
- 2024Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignmentcited by 26
- 2024Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages?cited by 23
- 2024Self-Alignment: Improving Alignment of Cultural Values in LLMs via In-Context Learningcited by 18
- 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?cited by 9
- 2025Societal Alignment Frameworks Can Improve LLM Alignmentcited by 8
- 2025Histoires Morales: A French Dataset for Assessing Moral Alignmentcited by 3
- 2025MENLO: From Preferences to Proficiency -- Evaluating and Modeling Native-like Quality Across 47 Languagescited by 3
- 2026compar:IA: The French Government's LLM arena to collect French-language human prompts and preference datacited by 2
- 2025ALIGN: Word Association Learning for Cultural Alignment in Large Language Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026CoCoA: Context-Conditional Cultural Alignment for Large Language Models30 Aug 2026
- 2026compar:IA: The French Government's LLM arena to collect French-language human prompts and preference data6 Feb 2026
- 2025MENLO: From Preferences to Proficiency -- Evaluating and Modeling Native-like Quality Across 47 Languages30 Sep 2025
- 2025ALIGN: Word Association Learning for Cultural Alignment in Large Language Models19 Aug 2025
- 2025Societal Alignment Frameworks Can Improve LLM Alignment27 Feb 2025
- 2025Histoires Morales: A French Dataset for Assessing Moral Alignment28 Jan 2025
- 2024Self-Pluralising Culture Alignment for Large Language Models16 Oct 2024
- 2024Self-Alignment: Improving Alignment of Cultural Values in LLMs via In-Context Learning29 Aug 2024
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignment24 Jul 2024
- 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?24 Jun 2024
- 2024Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignment18 Apr 2024
- 2024Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages?28 Feb 2024
12 newest of 13 All 13 (JSON)
- 2024Benchmarking Vision Language Models for Cultural Understandingcited by 100
- 2025Grounding Multilingual Multimodal LLMs With Cultural Knowledgecited by 16
- 2024From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Modelscited by 14
- 2024Exploring Visual Culture Awareness in GPT-4V: A Comprehensive Probingcited by 12
- 2024The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioningcited by 9
- 2024CIC: A Framework for Culturally-Aware Image Captioningcited by 8
- 2025Evaluation of Cultural Competence of Vision-Language Modelscited by 3
- 2024Crossroads of Continents: Automated Artifact Extraction for Cultural Adaptation with Large Multimodal Modelscited by 2
- 2025Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generationcited by 1
- 2026Beyond Translation: Cross-Cultural Meme Transcreation with Vision-Language Modelscited by 0
- 2026MiSCHiEF: A Benchmark in Minimal-Pairs of Safety and Culture for Holistic Evaluation of Fine-Grained Image-Caption Alignmentcited by 0
- 2026Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliabilitycited by 0
- 2026Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability7 Jul 2026
- 2026MiSCHiEF: A Benchmark in Minimal-Pairs of Safety and Culture for Holistic Evaluation of Fine-Grained Image-Caption Alignment21 Feb 2026
- 2026Beyond Translation: Cross-Cultural Meme Transcreation with Vision-Language Models23 Jan 2026
- 2025Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generation22 Aug 2025
- 2025Grounding Multilingual Multimodal LLMs With Cultural Knowledge10 Aug 2025
- 2025Evaluation of Cultural Competence of Vision-Language Models28 May 2025
- 2024The Power of Many: Multi-Agent Multimodal Models for Cultural Image Captioning18 Nov 2024
- 2024Benchmarking Vision Language Models for Cultural Understanding15 Jul 2024
- 2024Crossroads of Continents: Automated Artifact Extraction for Cultural Adaptation with Large Multimodal Models2 Jul 2024
- 2024From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models28 Jun 2024
- 2024Exploring Visual Culture Awareness in GPT-4V: A Comprehensive Probing8 Feb 2024
- 2024CIC: A Framework for Culturally-Aware Image Captioning8 Feb 2024
- 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
- 2024IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provincescited by 38
- 2023Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayingscited by 32
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subculturescited by 23
- 2026Toward Culturally Aligned LLMs through Ontology-Guided Multi-Agent Reasoningcited by 3
- 2026XCR-Bench: Benchmarking Cross-Cultural Reasoning in LLMs via Culture-Specific Items and Hall's Triadcited by 2
- 2025Everyday Physics in Korean Contexts: A Culturally Grounded Physical Reasoning Benchmarkcited by 1
- 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialoguescited by 0
- 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues30 Apr 2026
- 2026Toward Culturally Aligned LLMs through Ontology-Guided Multi-Agent Reasoning29 Jan 2026
- 2026XCR-Bench: Benchmarking Cross-Cultural Reasoning in LLMs via Culture-Specific Items and Hall's Triad20 Jan 2026
- 2025Everyday Physics in Korean Contexts: A Culturally Grounded Physical Reasoning Benchmark22 Sep 2025
- 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers7 Apr 2024
- 2024IndoCulture: Exploring Geographically-Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provinces2 Apr 2024
- 2024DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures23 Feb 2024
- 2023Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayings15 Sep 2023
- 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harmcited by 67
- 2024CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledgecited by 28
- 2025Attributional Safety Failures in Large Language Models under Code-Mixed Perturbationscited by 6
- 2025Attributional Safety Failures in Large Language Models under Code-Mixed Perturbations20 May 2025
- 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harm26 Jun 2024
- 2024CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledge10 Apr 2024
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
- 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
- 2024BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languagescited by 171
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
- 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 147
- 2022The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluationcited by 133
- 2023Language Model Behavior: A Comprehensive Surveycited by 92
- 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
- 2022Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Surveycited by 80
- 2023BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfercited by 68
- 2023SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Modelscited by 66
12 most cited of 177 All 177 (JSON)
- 2026Evaluating Cultural Awareness of LLMs for Haitian Creole25 Sep 2026
- 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditing21 Sep 2026
- 2026HerHealthEval: Evaluating Multilingual and Register-Sensitive Understanding of Women's Health Communication17 Sep 2026
- 2026Evaluating Communicative Success in Machine-Translated Conversation17 Sep 2026
- 2026Why Pretraining Fails to Share Cross-Lingual Knowledge16 Sep 2026
- 2026Multilingual in Name Only? Cultural and Linguistic Weaknesses of LLMs in Urdu9 Sep 2026
- 2026Perspectives on Cross-Lingual Consistency in LLMs for Medical Questions7 Sep 2026
- 2026Probing Factual Knowledge Transfer with Training Data Interventions1 Sep 2026
- 2026AtlasNLP: A Country-Aware Atlas of Dataset Representation in NLP31 Aug 2026
- 2026Pad=artha: Ontology-Grounded Fine-Grained NER Benchmark for Classical Sanskrit29 Aug 2026
- 2026Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding27 Aug 2026
- 2026Beyond Surface Cues: Disentangling Sociocultural Signals in Multilingual LLMs24 Aug 2026
12 newest of 177 All 177 (JSON)