mlsanityData to 7 Oct 2026

Towards a Human-like Open-Domain Chatbot

arXiv 2001.09977 ↗First posted 27 Jan 2020cs.CL cs.LG cs.NEcited by 467

Not on the map. Why?

Cited by 22 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present Meena, a multi-turn open-domain chatbot trained end-to-end on data mined and filtered from public domain social media conversations. This 2.6B parameter neural network is simply trained to minimize perplexity of the next token. We also propose a human evaluation metric called Sensibleness and Specificity Average (SSA), which captures key elements of a human-like multi-turn conversation. Our experiments show strong correlation between perplexity and SSA. The fact that the best perplexity end-to-end trained Meena scores high on SSA (72% on multi-turn evaluation) suggests that a human-level SSA of 86% is potentially within reach if we can better optimize perplexity. Additionally, the full version of Meena (with a filtering mechanism and tuned decoding) scores 79% SSA, 23% higher in absolute SSA than the existing chatbots we evaluated.

Key facts. Cited by 467 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jan 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 2; 2021: 119; 2022: 108; 2023: 133; 2024: 55; 2025: 32; 2026: 18.

467 papers.

Sort:

By area:

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  3. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  4. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  5. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  6. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  7. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  8. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
  9. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  10. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
  11. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  12. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
38 more
  1. 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 657
  2. 2023A Comprehensive Overview of Large Language Modelscited by 639
  3. 2021Carbon Emissions and Large Neural Network Trainingcited by 561
  4. 2023The Falcon Series of Open Language Modelscited by 526
  5. 2023GPTScore: Evaluate as You Desirecited by 357
  6. 2021Pre-Trained Models: Past, Present and Futurecited by 319
  7. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
  8. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
  9. 2022Long Range Language Modeling via Gated State Spacescited by 265
  10. 2023Challenges and Applications of Large Language Modelscited by 251
  11. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  12. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 221
  13. 2021Internet-Augmented Dialogue Generationcited by 217
  14. 2023Improving CLIP Training with Language Rewritescited by 216
  15. 2023CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Servingcited by 199
  16. 2023Universal Self-Consistency for Large Language Model Generationcited by 198
  17. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  18. 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
  19. 2023Video Probabilistic Diffusion Models in Projected Latent Spacecited by 171
  20. 2021Meta-learning via Language Model In-context Tuningcited by 163
  21. 2021Primer: Searching for Efficient Transformers for Language Modelingcited by 162
  22. 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
  23. 2023Foundation Models for Decision Making: Problems, Methods, and Opportunitiescited by 160
  24. 2022Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanationscited by 159
  25. 2023Progressive-Hint Prompting Improves Reasoning in Large Language Modelscited by 147
  26. 2021Bias Out-of-the-Box: An Empirical Analysis of Intersectional Occupational Biases in Popular Generative Language Modelscited by 141
  27. 2023From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacycited by 137
  28. 2023Auditing large language models: a three-layered approachcited by 135
  29. 2021Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answeringcited by 131
  30. 2022Generative Spoken Dialogue Language Modelingcited by 125
  31. 2023A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasetscited by 123
  32. 2022Pretrained Language Models for Text Generation: A Surveycited by 121
  33. 2022Calibrating Sequence likelihood Improves Conditional Language Generationcited by 121
  34. 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
  35. 2024Language Model Cascades: Token-level uncertainty and beyondcited by 115
  36. 2022Long Time No See! Open-Domain Conversation with Long-Term Persona Memorycited by 107
  37. 2022Block-Recurrent Transformerscited by 107
  38. 2021GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injectioncited by 102

50 most cited of 467 All 467 (JSON)