mlsanityData to 14 Oct 2026

Ethical Challenges in Data-Driven Dialogue Systems

arXiv 1711.09050 ↗First posted 24 Nov 2017cs.CLcited by 86

Not on the map. Why?

Abstract (arXiv)

The use of dialogue systems as a medium for human-machine interaction is an increasingly prevalent paradigm. A growing number of dialogue systems use conversation strategies that are learned from large datasets. There are well documented instances where interactions with these system have resulted in biased or even offensive conversations due to the data-driven training process. Here, we highlight potential ethical issues that arise in dialogue systems research, including: implicit biases in data-driven systems, the rise of adversarial examples, potential sources of privacy violations, safety concerns, special considerations for reinforcement learning systems, and reproducibility concerns. We also suggest areas stemming from these issues that deserve further investigation. Through this initial survey, we hope to spur research leading to robust, safe, and ethically sound dialogue systems.

Key facts. Cited by 86 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Nov 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 16; 2022: 19; 2023: 24; 2024: 17; 2025: 8; 2026: 2.

86 papers.

Sort:

By area:

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  3. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  4. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  5. 2022Red Teaming Language Models with Language Modelscited by 1,026
  6. 2022Quantifying Memorization Across Neural Language Modelscited by 763
  7. 2023Extracting Training Data from Diffusion Modelscited by 732
  8. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
  9. 2021True Few-Shot Learning with Language Modelscited by 344
  10. 2023Pretraining Language Models with Human Preferencescited by 247
  11. 2021Societal Biases in Language Generation: Progress and Challengescited by 202
  12. 2022What Does it Mean for a Language Model to Preserve Privacy?cited by 195
38 more
  1. 2021Alignment of Language Agentscited by 168
  2. 2023Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attackscited by 158
  3. 2021Counterfactual Memorization in Neural Language Modelscited by 156
  4. 2021RedditBias: A Real-World Resource for Bias Evaluation and Debiasing of Conversational Language Modelscited by 149
  5. 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studiescited by 131
  6. 2023Foundation Models and Fair Usecited by 116
  7. 2021Detoxifying Language Models Risks Marginalizing Minority Voicescited by 107
  8. 2021Trustworthy AI: A Computational Perspectivecited by 93
  9. 2021A Survey on Gender Bias in Natural Language Processingcited by 89
  10. 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 89
  11. 2023DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Modelscited by 79
  12. 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
  13. 2022Do Language Models Plagiarize?cited by 73
  14. 2021Software Engineering for AI-Based Systems: A Surveycited by 69
  15. 2024Quantifying Contamination in Evaluating Code Generation Capabilities of Language Modelscited by 65
  16. 2022In conversation with Artificial Intelligence: aligning language models with human valuescited by 62
  17. 2024SoK: Membership Inference Attacks on LLMs are Rushing Nowhere (and How to Fix It)cited by 59
  18. 2023Training Data Extraction From Pre-trained Language Models: A Surveycited by 45
  19. 2024Copyright Traps for Large Language Modelscited by 37
  20. 2022Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarkscited by 36
  21. 2021Revealing Persona Biases in Dialogue Systemscited by 33
  22. 2021MMChat: Multi-Modal Chat Dataset on Social Mediacited by 30
  23. 2024Undesirable Memorization in Large Language Models: A Surveycited by 29
  24. 2024Navigating LLM Ethics: Advancements, Challenges, and Future Directionscited by 28
  25. 2021Evaluating Gender Bias in Natural Language Inferencecited by 27
  26. 2022Robust Conversational Agents against Imperceptible Toxicity Triggerscited by 23
  27. 2022Equi-Tuning: Group Equivariant Fine-Tuning of Pretrained Modelscited by 22
  28. 2023Weakly Supervised Detection of Hallucinations in LLM Activationscited by 20
  29. 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscapecited by 18
  30. 2024MobileAgent: enhancing mobile control via human-machine interaction and SOP integrationcited by 18
  31. 2022MoralDial: A Framework to Train and Evaluate Moral Dialogue Systems via Moral Discussionscited by 17
  32. 2021The R-U-A-Robot Dataset: Helping Avoid Chatbot Deception by Detecting User Questions About Human or Non-Human Identitycited by 16
  33. 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
  34. 2025A Vision for Access Control in LLM-based Agent Systemscited by 14
  35. 2024REVS: Unlearning Sensitive Information in Language Models via Rank Editing in the Vocabulary Spacecited by 13
  36. 2023Where's the Liability in Harmful AI Speech?cited by 12
  37. 2024SafeWorld: Geo-Diverse Safety Alignmentcited by 11
  38. 2026SPASM: Stable Persona-driven Agent Simulation for Multi-turn Dialogue Generationcited by 11

50 most cited of 86 All 86 (JSON)