mlsanityData to 7 Oct 2026

Less is More: Mitigate Spurious Correlations for Open-Domain Dialogue Response Generation Models by Causal Discovery

arXiv 2303.01962 ↗First posted 2 Mar 2023cs.CL cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

In this paper, we conduct the first study on spurious correlations for open-domain response generation models based on a corpus CGDIALOG curated in our work. The cur rent models indeed suffer from spurious correlations and have a tendency of generating irrelevant and generic responses. Inspired by causal discovery algorithms, we propose a novel model-agnostic method for training and inference of response generation model using a conditional independence classifier. The classifier is trained by a constrained self-training method, coined CONSTRAIN, to overcome data scarcity. The experimental results based on both human and automatic evaluation show that our method significantly outperforms the competitive baselines in terms of relevance, informativeness, and fluency.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 44 of its 65 references that are in the map. First posted on arXiv 2 Mar 2023.

Builds on

44 of 65 references.

References · 44

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  7. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  8. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  9. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  10. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  11. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  12. 2020Recipes for building an open-domain chatbotcited by 593
32 more
  1. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  2. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
  3. 2019Confidence Regularized Self-Trainingcited by 418
  4. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
  5. 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
  6. 2020An Investigation of Why Overparameterization Exacerbates Spurious Correlationscited by 310
  7. 2021Towards Emotional Support Dialog Systemscited by 294
  8. 2020The Pushshift Reddit Datasetcited by 289
  9. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
  10. 2016Revisiting Classifier Two-Sample Testscited by 258
  11. 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
  12. 2017Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memorycited by 167
  13. 2019PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variablecited by 145
  14. 2019Unsupervised Domain Adaptation through Self-Supervisioncited by 116
  15. 2017Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotationcited by 77
  16. 2018RankME: Reliable Human Ratings for Natural Language Generationcited by 67
  17. 2020Recognizing Emotion Cause in Conversationscited by 66
  18. 2019Do Neural Dialog Systems Use the Conversation History Effectively? An Empirical Studycited by 47
  19. 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
  20. 2017Model-Powered Conditional Independence Testcited by 43
  21. 2021CoMAE: A Multi-factor Hierarchical Framework for Empathetic Response Generationcited by 42
  22. 2021Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterancescited by 40
  23. 2019Conditional Independence Testing using Generative Adversarial Networkscited by 36
  24. 2020Do Response Selection Models Really Know What's Next? Utterance Manipulation Strategies for Multi-turn Response Selectioncited by 36
  25. 2021Data-to-text Generation with Macro Planningcited by 34
  26. 2019Improving Neural Conversational Models with Entropy-Based Data Filteringcited by 30
  27. 2019Informative and Controllable Opinion Summarizationcited by 27
  28. 2022A Literature Survey of Recent Advances in Chatbotscited by 26
  29. 2018Adversarial Over-Sensitivity and Over-Stability Strategies for Dialogue Modelscited by 25
  30. 2021Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summariescited by 15
  31. 2021How to Evaluate a Summarizer: Study Design and Statistical Analysis for Manual Linguistic Quality Evaluationcited by 7
  32. 2018Mimic and Classify : A meta-algorithm for Conditional Independence Testingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 2; 2026: 1.

10 papers.

  1. 2024RENOVI: A Benchmark Towards Remediating Norm Violations in Socio-Cultural Conversationscited by 14
  2. 2025LazyReview A Dataset for Uncovering Lazy Thinking in NLP Peer Reviewscited by 13
  3. 2024On the Reliability of Large Language Models for Causal Discoverycited by 12
  4. 2024Empathy Level Alignment via Reinforcement Learning for Empathetic Response Generationcited by 8
  5. 2024CausalScore: An Automatic Reference-Free Metric for Assessing Response Relevance in Open-Domain Dialogue Systemscited by 5
  6. 2024Learning in Order! A Sequential Strategy to Learn Invariant Features for Multimodal Sentiment Analysiscited by 2
  7. 2025IRIS: An Iterative and Integrated Framework for Verifiable Causal Discovery in the Absence of Tabular Datacited by 2
  8. 2024IMO: Greedy Layer-Wise Sparse Representation Learning for Out-of-Distribution Text Classification with Pre-trained Modelscited by 0
  9. 2024Position Debiasing Fine-Tuning for Causal Perception in Long-Term Dialoguecited by 0
  10. 2026Reviewing the Reviewer: LLM-Assisted Reviewer Feedback Generation for Guideline Compliancecited by 0