mlsanityData to 7 Oct 2026

TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents

arXiv 1901.08149 ↗First posted 23 Jan 2019cs.CLcited by 188

Not on the map. Why?

Abstract (arXiv)

We introduce a new approach to generative data-driven dialogue systems (e.g. chatbots) called TransferTransfo which is a combination of a Transfer learning based training scheme and a high-capacity Transformer model. Fine-tuning is performed by using a multi-task objective which combines several unsupervised prediction tasks. The resulting fine-tuned model shows strong improvements over the current state-of-the-art end-to-end conversational models like memory augmented seq2seq and information-retrieval models. On the privately held PERSONA-CHAT dataset of the Conversational Intelligence Challenge 2, this approach obtains a new state-of-the-art, with respective perplexity, Hits@1 and F1 metrics of 16.28 (45 % absolute improvement), 80.7 (46 % absolute improvement) and 19.5 (20 % absolute improvement).

Key facts. Cited by 188 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jan 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 68; 2022: 48; 2023: 33; 2024: 26; 2025: 6; 2026: 7.

188 papers.

Sort:

By area:

  1. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  2. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  3. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  4. 2021Hurdles to Progress in Long-form Question Answeringcited by 166
  5. 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
  6. 2022On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?cited by 137
  7. 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
  8. 2022Pretrained Language Models for Text Generation: A Surveycited by 121
  9. 2021Pretrained Language Models for Text Generation: A Surveycited by 95
  10. 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 78
  11. 2021Evaluating Attribution in Dialogue Systems: The BEGIN Benchmarkcited by 75
  12. 2021BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Datacited by 75
38 more
  1. 2021Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systemscited by 73
  2. 2022DFX: A Low-latency Multi-FPGA Appliance for Accelerating Transformer-based Text Generationcited by 46
  3. 2021Measuring Conversational Uptake: A Case Study on Student-Teacher Interactionscited by 44
  4. 2021Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Explorationcited by 44
  5. 2023Prompting Large Language Models With the Socratic Methodcited by 43
  6. 2021Towards Knowledge-Grounded Counter Narrative Generation for Hate Speechcited by 41
  7. 2021One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profilescited by 39
  8. 2022PAL: Persona-Augmented Emotional Support Conversation Generationcited by 39
  9. 2023Transformers in Speech Processing: A Surveycited by 38
  10. 2022Prompt Injection: Parameterization of Fixed Inputscited by 35
  11. 2021Commonsense-Focused Dialogues for Response Generation: An Empirical Studycited by 30
  12. 2021Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledgecited by 30
  13. 2021Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generationcited by 29
  14. 2021Controllable Abstractive Dialogue Summarization with Sketch Supervisioncited by 27
  15. 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
  16. 2022A Model-Agnostic Data Manipulation Method for Persona-based Dialogue Generationcited by 25
  17. 2021Decomposed Mutual Information Estimation for Contrastive Representation Learningcited by 24
  18. 2022Personalized Dialogue Generation with Persona-Adaptive Attentioncited by 24
  19. 2023Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Personacited by 24
  20. 2021Argument Undermining: Counter-Argument Generation by Attacking Weak Premisescited by 22
  21. 2022Multi-Stage Prompting for Knowledgeable Dialogue Generationcited by 22
  22. 2021Structural Pre-training for Dialogue Comprehensioncited by 20
  23. 2021Exploring Prompt-based Few-shot Learning for Grounded Dialog Generationcited by 20
  24. 2022COSPLAY: Concept Set Guided Personalized Dialogue Generation Across Both Party Personascited by 20
  25. 2021End-to-End Learning of Flowchart Grounded Task-Oriented Dialogscited by 19
  26. 2022A Personalized Dialogue Generator with Implicit User Persona Detectioncited by 19
  27. 2021CharacterChat: Supporting the Creation of Fictional Characters through Conversation and Progressive Manifestation with a Chatbotcited by 18
  28. 2022What is wrong with you?: Leveraging User Sentiment for Automatic Dialog Evaluationcited by 18
  29. 2024Learning Retrieval Augmentation for Personalized Dialogue Generationcited by 18
  30. 2021QAConv: Question Answering on Informative Conversationscited by 17
  31. 2022Learning Dialogue Representations from Consecutive Utterancescited by 17
  32. 2022Improving Personality Consistency in Conversation by Persona Extendingcited by 17
  33. 2023Learning to Memorize Entailment and Discourse Relations for Persona-Consistent Dialoguescited by 17
  34. 2023Towards Robust Personalized Dialogue Generation via Order-Insensitive Representation Regularizationcited by 17
  35. 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
  36. 2021Towards an Online Empathetic Chatbot with Emotion Causescited by 16
  37. 2021Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluationcited by 16
  38. 2022There Are a Thousand Hamlets in a Thousand People's Eyes: Enhancing Knowledge-grounded Dialogue with Personal Memorycited by 16

50 most cited of 188 All 188 (JSON)