mlsanityData to 7 Oct 2026

SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization

arXiv 2212.10465 ↗First posted 20 Dec 2022cs.CLcited by 166

Not on the map. Why?

Cited by 21 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Data scarcity has been a long standing issue in the field of open-domain social dialogue. To quench this thirst, we present SODA: the first publicly available, million-scale high-quality social dialogue dataset. By contextualizing social commonsense knowledge from a knowledge graph, we are able to distill an exceptionally broad spectrum of social interactions from a large language model. Human evaluation shows that conversations in SODA are more consistent, specific, and (surprisingly) natural than those in prior human-authored datasets. Using SODA, we train COSMO: a generalizable conversation model that is significantly more natural and consistent on unseen datasets than best-performing conversation models (e.g., GODEL, BlenderBot-1, Koala, Vicuna). Experiments reveal COSMO is sometimes even preferred to the original human-written gold responses. Additionally, our results shed light on the distinction between knowledge-enriched conversations and natural social chitchats. We plan to make our data, model, and code public.

Key facts. Cited by 166 papers in the map (data through 7 Oct 2026). Builds on 43 of its 72 references that are in the map. First posted on arXiv 20 Dec 2022.

Builds on

43 of 72 references.

References · 43

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  6. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  7. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  8. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  9. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  10. 2021Ethical and social risks of harm from Language Modelscited by 957
  11. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
  12. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
31 more
  1. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  2. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  3. 2020Recipes for building an open-domain chatbotcited by 593
  4. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  5. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
  6. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  7. 2020The Pushshift Reddit Datasetcited by 289
  8. 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
  9. 2021Surface Form Competition: Why the Highest Probability Answer Isn't Always Rightcited by 256
  10. 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
  11. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 245
  12. 2022Scaling Up Models and Data with textttt5x and textttseqiocited by 187
  13. 2019Queens are Powerful too: Mitigating Gender Bias in Dialogue Generationcited by 152
  14. 2019What makes a good conversation? How controllable attributes affect human judgmentscited by 140
  15. 2020Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend Skillscited by 130
  16. 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
  17. 2022Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agentscited by 62
  18. 2018Modeling Naive Psychology of Characters in Simple Commonsense Storiescited by 59
  19. 2021Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contextscited by 56
  20. 2022GODEL: Large-Scale Pre-Training for Goal-Directed Dialogcited by 50
  21. 2022Controllable Dialogue Simulation with In-Context Learningcited by 42
  22. 2021Revealing Persona Biases in Dialogue Systemscited by 33
  23. 2022Weakly Supervised Data Augmentation Through Prompting for Dialogue Understandingcited by 32
  24. 2021AuGPT: Auxiliary Tasks and Data Augmentation for End-To-End Dialogue with Pre-Trained Language Modelscited by 31
  25. 2021Commonsense-Focused Dialogues for Response Generation: An Empirical Studycited by 30
  26. 2021Hi, my name is Martha: Using names to measure and mitigate bias in generative dialogue modelscited by 23
  27. 2022Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Qualitycited by 22
  28. 2021GOLD: Improving Out-of-Scope Detection in Dialogues using Data Augmentationcited by 20
  29. 2022Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challengescited by 13
  30. 2022BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Datasetscited by 13
  31. 2022Counterfactual Data Augmentation via Perspective Transition for Open-Domain Dialoguescited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 48; 2024: 62; 2025: 39; 2026: 17.

166 papers.

Sort:

By area:

  1. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  2. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
  3. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
  4. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 449
  5. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
  6. 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 218
  7. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  8. 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
  9. 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 198
  10. 2023MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problemscited by 128
  11. 2024Keyformer: KV Cache Reduction through Key Tokens Selection for Efficient Generative Inferencecited by 124
  12. 2023Retrieval meets Long Context Large Language Modelscited by 114
38 more
  1. 2023The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuningcited by 106
  2. 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
  3. 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
  4. 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
  5. 2023Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Studycited by 63
  6. 2023Prompted LLMs as Chatbot Modules for Long Open-domain Conversationcited by 61
  7. 2023Prompt-Based Monte-Carlo Tree Search for Goal-Oriented Dialogue Policy Planningcited by 60
  8. 2024Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theorycited by 60
  9. 2024Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMscited by 59
  10. 2023Elo Uncovered: Robustness and Best Practices in Language Model Evaluationcited by 58
  11. 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Modelscited by 54
  12. 2023InstructRetro: Instruction Tuning post Retrieval-Augmented Pretrainingcited by 53
  13. 2024SimpleToM: Exposing the Gap between Explicit ToM Inference and Implicit ToM Application in LLMscited by 51
  14. 2024BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Datacited by 49
  15. 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
  16. 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 47
  17. 2023Faithful Persona-based Conversational Dataset Generation with Large Language Modelscited by 45
  18. 2024Designing a Dashboard for Transparency and Control of Conversational AIcited by 43
  19. 2023Compressed Context Memory For Online Language Model Interactioncited by 42
  20. 2023Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agentscited by 41
  21. 2023COBRA Frames: Contextual Reasoning about Effects and Harms of Offensive Statementscited by 34
  22. 2024Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extractioncited by 33
  23. 2023Controllable Mixed-Initiative Dialogue Generation through Promptingcited by 32
  24. 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasingcited by 31
  25. 2024Genie: Achieving Human Parity in Content-Grounded Datasets Generationcited by 31
  26. 2024AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agentscited by 28
  27. 2024SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domainscited by 28
  28. 2023COKE: A Cognitive Knowledge Graph for Machine Theory of Mindcited by 26
  29. 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
  30. 2024Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Modelscited by 26
  31. 2024Book2Dial: Generating Teacher-Student Interactions from Textbooks for Cost-Effective Development of Educational Chatbotscited by 25
  32. 2025Simple Prompt Injection Attacks Can Leak Personal Data Observed by LLM Agents During Task Executioncited by 25
  33. 2023NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violationcited by 24
  34. 2024A Survey on Recent Advances in Conversational Data Generationcited by 23
  35. 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 21
  36. 2024Cultural Commonsense Knowledge for Intercultural Dialoguescited by 20
  37. 2023Which Prompts Make The Difference? Data Prioritization For Efficient Human LLM Evaluationcited by 18
  38. 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18

50 most cited of 166 All 166 (JSON)