mlsanityData to 7 Oct 2026

NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violation

arXiv 2310.14563 ↗First posted 23 Oct 2023cs.CL cs.CYcited by 24

Not on the map. Why?

Abstract (arXiv)

Social norms fundamentally shape interpersonal communication. We present NormDial, a high-quality dyadic dialogue dataset with turn-by-turn annotations of social norm adherences and violations for Chinese and American cultures. Introducing the task of social norm observance detection, our dataset is synthetically generated in both Chinese and English using a human-in-the-loop pipeline by prompting large language models with a small collection of expert-annotated social norms. We show that our generated dialogues are of high quality through human evaluation and further evaluate the performance of existing large language models on this task. Our findings point towards new directions for understanding the nuances of social norms as they manifest in conversational contexts that span across languages and cultures.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

20 of 39 references.

References · 20

  1. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  2. 2021Ethical and social risks of harm from Language Modelscited by 957
  3. 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
  4. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  5. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  6. 2020Social Chemistry 101: Learning to Reason about Social and Moral Normscited by 253
  7. 2021Visually Grounded Reasoning across Languages and Culturescited by 188
  8. 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
  9. 2021Can Machines Learn Morality? The Delphi Experimentcited by 140
  10. 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
  11. 2022The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systemscited by 92
  12. 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
8 more
  1. 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
  2. 2023NormBank: A Knowledge Bank of Situational Social Normscited by 60
  3. 2022NormSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Flycited by 48
  4. 2023The Parrot Dilemma: Human-Labeled vs. LLM-augmented Data in Classification Taskscited by 35
  5. 2023Sociocultural Norm Similarities and Differences via Situational Alignment and Explainable Textual Entailmentcited by 22
  6. 2020Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Datacited by 20
  7. 2021DREAM: Improving Situational QA by First Elaborating the Situationcited by 18
  8. 2021Generative Conversational Networkscited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 8; 2026: 8.

24 papers.

Sort:

By area:

  1. 2024Massively Multi-Cultural Knowledge Acquisition & LM Benchmarkingcited by 63
  2. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontierscited by 49
  3. 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
  4. 2024Cultural Commonsense Knowledge for Intercultural Dialoguescited by 20
  5. 2025Multiple LLM Agents Debate for Equitable Cultural Alignmentcited by 20
  6. 2024CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Modelscited by 16
  7. 2025We Politely Insist: Your LLM Must Learn the Persian Art of Taarofcited by 6
  8. 2025Bottom-Up Synthesis of Knowledge-Grounded Task-Oriented Dialogues with Iteratively Self-Refined Promptscited by 5
  9. 2025Isolating Culture Neurons in Multilingual Large Language Modelscited by 4
  10. 2025VideoNorms: Benchmarking Cultural Awareness of Video Language Modelscited by 4
  11. 2025MINDS: A Cross-cultural Dialogue Corpus for Social Norm Classification and Adherence Detectioncited by 4
  12. 2024Learning from Implicit User Feedback, Emotions and Demographic Information in Task-Oriented and Document-Grounded Dialoguescited by 3
12 more
  1. 2025Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Cultural Intelligence with CQ-Benchcited by 3
  2. 2024LLM-Human Pipeline for Cultural Context Grounding of Conversationscited by 2
  3. 2025NormGenesis: Multicultural Dialogue Generation via Exemplar-Guided Social Norm Modeling and Violation Recoverycited by 2
  4. 2024Scalable Frame-based Construction of Sociocultural NormBases for Socially-Aware Dialoguescited by 1
  5. 2026All Required, In Order: Phase-Level Evaluation for AI-Human Dialogue in Healthcare and Beyondcited by 1
  6. 2026AdaCultureSafe: Adaptive Cultural Safety Grounded by Cultural Knowledge in Large Language Modelscited by 0
  7. 2026Evaluating LLM-Simulated Conversations in Modeling Inconsistent and Uncollaborative Behaviors in Human Social Interactioncited by 0
  8. 2026EUDAIMONIA: Evaluating Undesirable Dynamics in AIcited by 0
  9. 2026PragAlign: Evidence-Sensitive Reply Assistance Across Chinese and Japanese Appropriateness Judgmentscited by 0
  10. 2026Toward Cultural Alignment: Human-Centered Evaluation of Multimodal AI Stories Across Five African Communitiescited by 0
  11. 2026Whisper-Based Speech Transcription from Videos Across Multiple Languages for Cross-Cultural Understandingcited by 0
  12. 2026FineWeb-CLaR: Culture, Language, and Region Annotations for Benchmark-Aligned Corpus Auditingcited by 0