Bridging Cultural Nuances in Dialogue Agents through Cultural Value Surveys
Not on the map. Why?
Abstract (arXiv)
The cultural landscape of interactions with dialogue agents is a compelling yet relatively unexplored territory. It's clear that various sociocultural aspects -- from communication styles and beliefs to shared metaphors and knowledge -- profoundly impact these interactions. To delve deeper into this dynamic, we introduce cuDialog, a first-of-its-kind benchmark for dialogue generation with a cultural lens. We also develop baseline models capable of extracting cultural attributes from dialogue exchanges, with the goal of enhancing the predictive accuracy and quality of dialogue agents. To effectively co-learn cultural understanding and multi-turn dialogue predictions, we propose to incorporate cultural dimensions with dialogue encoding features. Our experimental findings highlight that incorporating cultural value surveys boosts alignment with references and cultural markers, demonstrating its considerable influence on personalization and dialogue quality. To facilitate further exploration in this exciting domain, we publish our benchmark publicly accessible at https://github.com/yongcaoplus/cuDialog.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 32 of its 58 references that are in the map. First posted on arXiv 18 Jan 2024.
Builds on
32 of 58 references.
References · 32
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2020Artificial Intelligence, Values and Alignmentcited by 443
- 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
20 more
- 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 203
- 2021Visually Grounded Reasoning across Languages and Culturescited by 188
- 2022Probing Pre-Trained Language Models for Cross-Cultural Differences in Valuescited by 147
- 2022The Ghost in the Machine has an American accent: value conflict in GPT-3cited by 105
- 2023Multi-lingual and Multi-cultural Figurative Language Understandingcited by 47
- 2022Speaking Multiple Languages Affects the Moral Bias of Language Modelscited by 34
- 2022Does Moral Code Have a Moral Code? Probing Delphi's Moral Philosophycited by 31
- 2020Pchatbot: A Large-Scale Dataset for Personalized Chatbotcited by 26
- 2023Cross-Cultural Transfer Learning for Chinese Offensive Language Detectioncited by 21
- 2022There Are a Thousand Hamlets in a Thousand People's Eyes: Enhancing Knowledge-grounded Dialogue with Personal Memorycited by 16
- 2022A Corpus for Understanding and Generating Moral Storiescited by 16
- 2021Unsupervised Enrichment of Persona-grounded Dialog with Background Storiescited by 14
- 2022MDIA: A Benchmark for Multilingual Dialogue Generation in 46 Languagescited by 13
- 2021Detecting Speaker Personas from Conversational Textscited by 8
- 2022Commonsense and Named Entity Aware Knowledge Grounded Dialogue Generationcited by 8
- 2022EnCBP: A New Benchmark Dataset for Finer-Grained Cultural Background Prediction in Englishcited by 7
- 2023NormMark: A Weakly Supervised Markov Model for Socio-cultural Norm Discoverycited by 5
- 2021A reproduction of Apple's bi-directional LSTM models for language identification in short stringscited by 4
- 2021Catchphrase: Automatic Detection of Cultural Referencescited by 4
- 2022The YiTrans End-to-End Speech Translation System for IWSLT 2022 Offline Shared Taskcited by 3
Built on by
Citing papers per year: 2024: 3; 2025: 6; 2026: 9.
18 papers.
Sort:
By area:
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2024Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipinocited by 3
- 2025EtiCor++: Towards Understanding Etiquettical Bias in LLMscited by 3
- 2025Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMscited by 2
- 2025Culture Cartography: Mapping the Landscape of Cultural Knowledgecited by 2
- 2026A Unified Framework to Quantify Cultural Intelligence of AIcited by 2
- 2026Structuring the Space of Sociotechnical Alignmentcited by 2
- 2025RusCode: Russian Cultural Code Benchmark for Text-to-Image Generationcited by 1
- 2026Cultural Authenticity: Comparing LLM Cultural Representations to Native Human Expectationscited by 1
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challengescited by 1
6 more
- 2025CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generationcited by 0
- 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialoguescited by 0
- 2026LLMs Infer Cultural Context but Fail to Apply It When Respondingcited by 0
- 2026CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict Mediationcited by 0
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systemscited by 0
- 2026Supporting and Performing Culture from the Insidecited by 0
- 2026Supporting and Performing Culture from the Inside26 Sep 2026
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems18 Sep 2026
- 2026CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict Mediation4 Sep 2026
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges18 Aug 2026
- 2026LLMs Infer Cultural Context but Fail to Apply It When Responding16 Jun 2026
- 2026Structuring the Space of Sociotechnical Alignment2 Jun 2026
- 2026Cultural Benchmarking of LLMs in Standard and Dialectal Arabic Dialogues30 Apr 2026
- 2026Cultural Authenticity: Comparing LLM Cultural Representations to Native Human Expectations3 Apr 2026
- 2026A Unified Framework to Quantify Cultural Intelligence of AI1 Mar 2026
- 2025Culture Cartography: Mapping the Landscape of Cultural Knowledge31 Oct 2025
- 2025Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMs16 Oct 2025
- 2025EtiCor++: Towards Understanding Etiquettical Bias in LLMs10 Jun 2025
6 more
- 2025CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generation7 May 2025
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLP17 Feb 2025
- 2025RusCode: Russian Cultural Code Benchmark for Text-to-Image Generation11 Feb 2025
- 2024Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipino20 Sep 2024
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Art6 Jun 2024
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Survey5 Mar 2024
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 166
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
- 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
- 2024Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipinocited by 3
- 2025EtiCor++: Towards Understanding Etiquettical Bias in LLMscited by 3
- 2025Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMscited by 2
- 2025Culture Cartography: Mapping the Landscape of Cultural Knowledgecited by 2
- 2026A Unified Framework to Quantify Cultural Intelligence of AIcited by 2
- 2026Structuring the Space of Sociotechnical Alignmentcited by 2
- 2025RusCode: Russian Cultural Code Benchmark for Text-to-Image Generationcited by 1
- 2026Cultural Authenticity: Comparing LLM Cultural Representations to Native Human Expectationscited by 1
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challengescited by 1
12 most cited of 17 All 17 (JSON)
- 2026Supporting and Performing Culture from the Inside26 Sep 2026
- 2026CultureMINE: Datasets and Methods for Improving the Cultural Capabilities of NLP Systems18 Sep 2026
- 2026CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict Mediation4 Sep 2026
- 2026Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges18 Aug 2026
- 2026LLMs Infer Cultural Context but Fail to Apply It When Responding16 Jun 2026
- 2026Structuring the Space of Sociotechnical Alignment2 Jun 2026
- 2026Cultural Authenticity: Comparing LLM Cultural Representations to Native Human Expectations3 Apr 2026
- 2026A Unified Framework to Quantify Cultural Intelligence of AI1 Mar 2026
- 2025Culture Cartography: Mapping the Landscape of Cultural Knowledge31 Oct 2025
- 2025Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMs16 Oct 2025
- 2025EtiCor++: Towards Understanding Etiquettical Bias in LLMs10 Jun 2025
- 2025CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generation7 May 2025
12 newest of 17 All 17 (JSON)