mlsanityData to 7 Oct 2026

The Second Conversational Intelligence Challenge (ConvAI2)

arXiv 1902.00098 ↗First posted 31 Jan 2019cs.AI cs.CL cs.HCcited by 178

Not on the map. Why?

Abstract (arXiv)

We describe the setting and results of the ConvAI2 NeurIPS competition that aims to further the state-of-the-art in open-domain chatbots. Some key takeaways from the competition are: (i) pretrained Transformer variants are currently the best performing models on this task, (ii) but to improve performance on multi-turn conversations with humans, future systems must go beyond single word metrics like perplexity to measure the performance across sequences of utterances (conversations) -- in terms of repetition, consistency and balance of dialogue acts (e.g. how many questions asked vs. answered).

Key facts. Cited by 178 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Jan 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 44; 2022: 50; 2023: 36; 2024: 20; 2025: 18; 2026: 10.

178 papers.

Sort:

By area:

  1. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  2. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  3. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  4. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
  5. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  6. 2023A Comprehensive Overview of Large Language Modelscited by 639
  7. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
  8. 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 405
  9. 2022OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalizationcited by 235
  10. 2022A Contrastive Framework for Neural Text Generationcited by 224
  11. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  12. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
38 more
  1. 2023Evaluating Large Language Models: A Comprehensive Surveycited by 200
  2. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  3. 2024A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicitycited by 179
  4. 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
  5. 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
  6. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
  7. 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
  8. 2022Long Time No See! Open-Domain Conversation with Long-Term Persona Memorycited by 107
  9. 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 94
  10. 2021A Comprehensive Assessment of Dialog Evaluation Metricscited by 90
  11. 2022On Decoding Strategies for Neural Text Generatorscited by 89
  12. 2021Anticipating Safety Issues in E2E Conversational AI: Framework and Toolingcited by 77
  13. 2021BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Datacited by 75
  14. 2021Building and Evaluating Open-Domain Dialogue Corpora with Clarifying Questionscited by 63
  15. 2022Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agentscited by 62
  16. 2021Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generationcited by 60
  17. 2021DynaEval: Unifying Turn and Dialogue Level Evaluationcited by 59
  18. 2021Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contextscited by 56
  19. 2021Domain-matched Pre-training Tasks for Dense Retrievalcited by 53
  20. 2023Multi-Party Chat: Conversational Agents in Group Settings with Humans and Modelscited by 53
  21. 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
  22. 2021DuRecDial 2.0: A Bilingual Parallel Corpus for Conversational Recommendationcited by 46
  23. 2022Neural Approaches to Conversational Information Retrievalcited by 41
  24. 2023Using In-Context Learning to Improve Dialogue Safetycited by 41
  25. 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
  26. 2022The CRINGE Loss: Learning what language not to modelcited by 39
  27. 2022DIRECTOR: Generator-Classifiers For Supervised Language Modelingcited by 38
  28. 2025Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profilescited by 38
  29. 2025Understanding the Repeat Curse in Large Language Models from a Feature Perspectivecited by 36
  30. 2021ValueNet: A New Dataset for Human Value Driven Dialogue Systemcited by 34
  31. 2023Opportunities and Challenges in Neural Dialog Tutoringcited by 33
  32. 2022Achieving Reliable Human Assessment of Open-Domain Dialogue Systemscited by 31
  33. 2023Query-Efficient Black-Box Red Teaming via Bayesian Optimizationcited by 31
  34. 2021Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledgecited by 30
  35. 2021Automatic Evaluation and Moderation of Open-domain Dialogue Systemscited by 28
  36. 2025From 1,000,000 Users to Every User: Scaling Up Personalized Preference for User-level Alignmentcited by 28
  37. 2022A Model-Agnostic Data Manipulation Method for Persona-based Dialogue Generationcited by 25
  38. 2025A Survey on Personalized and Pluralistic Preference Alignment in Large Language Modelscited by 25

50 most cited of 178 All 178 (JSON)