ParlAI: A Dialog Research Software Platform
Not on the map. Why?
Abstract (arXiv)
We introduce ParlAI (pronounced "par-lay"), an open-source software platform for dialog research implemented in Python, available at http://parl.ai. Its goal is to provide a unified framework for sharing, training and testing of dialog models, integration of Amazon Mechanical Turk for data collection, human evaluation, and online/reinforcement learning; and a repository of machine learning models for comparing with others' models, and improving upon existing architectures. Over 20 tasks are supported in the first release, including popular datasets such as SQuAD, bAbI tasks, MCTest, WikiQA, QACNN, QADailyMail, CBT, bAbI Dialog, Ubuntu, OpenSubtitles and VQA. Several models are integrated, including neural models such as memory networks, seq2seq and attentive LSTMs.
Key facts. Cited by 139 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 35; 2022: 36; 2023: 41; 2024: 15; 2025: 9; 2026: 3.
139 papers.
Sort:
By area:
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
- 2021Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answeringcited by 131
- 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
- 2023Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversationscited by 88
- 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 86
- 2022The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialoguescited by 78
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2022RankGen: Improving Text Generation with Large Ranking Modelscited by 72
- 2021CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systemscited by 60
- 2022Perturbation Augmentation for Fairer NLPcited by 51
38 more
- 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
- 2023Faithful Persona-based Conversational Dataset Generation with Large Language Modelscited by 45
- 2021Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causescited by 43
- 2023Using In-Context Learning to Improve Dialogue Safetycited by 41
- 2022The CRINGE Loss: Learning what language not to modelcited by 39
- 2021TWEAC: Transformer with Extendable QA Agent Classifierscited by 37
- 2021Factual Consistency Evaluation for Text Summarization via Counterfactual Estimationcited by 37
- 2021SaFeRDialogues: Taking Feedback Gracefully after Conversational Safety Failurescited by 37
- 2023Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systemscited by 37
- 2021Revealing Persona Biases in Dialogue Systemscited by 33
- 2023Opportunities and Challenges in Neural Dialog Tutoringcited by 33
- 2021Reason first, then respond: Modular Generation for Knowledge-infused Dialoguecited by 32
- 2023Foundation Metrics for Evaluating Effectiveness of Healthcare Conversations Powered by Generative AIcited by 32
- 2021Conversational Question Answering: A Surveycited by 31
- 2022Why So Toxic? Measuring and Triggering Toxic Behavior in Open-Domain Chatbotscited by 31
- 2023ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writingcited by 31
- 2023Query-Efficient Black-Box Red Teaming via Bayesian Optimizationcited by 31
- 2023Training Models to Generate, Recognize, and Reframe Unhelpful Thoughtscited by 31
- 2023A Large Language Model Enhanced Conversational Recommender Systemcited by 31
- 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Modelscited by 30
- 2022Using Interactive Feedback to Improve the Accuracy and Explainability of Question Answering Systems Post-Deploymentcited by 25
- 2022Scalable Interpretability via Polynomialscited by 25
- 2023Zero-Shot Robustification of Zero-Shot Modelscited by 24
- 2021Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identitycited by 22
- 2022Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Qualitycited by 22
- 2022ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Formatcited by 22
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 21
- 2025When Large Language Models are Reliable for Judging Empathic Communicationcited by 21
- 2022COSPLAY: Concept Set Guided Personalized Dialogue Generation Across Both Party Personascited by 20
- 2021A Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generationcited by 19
- 2021Ditch the Gold Standard: Re-evaluating Conversational Question Answeringcited by 19
- 2022DialogCC: An Automated Pipeline for Creating High-Quality Multi-Modal Dialogue Datasetcited by 17
- 2021Towards Automatic Evaluation of Dialog Systems: A Model-Free Off-Policy Evaluation Approachcited by 16
- 2021Assessing Dialogue Systems with Distribution Distancescited by 16
- 2022SalesBot: Transitioning from Chit-Chat to Task-Oriented Dialoguescited by 16
- 2022Measuring and Improving Semantic Diversity of Dialogue Generationcited by 16
- 2021TextBox: A Unified, Modularized, and Extensible Framework for Text Generationcited by 15
50 most cited of 139 All 139 (JSON)
- 2026Orcheo: A Modular Full-Stack Platform for Conversational Search16 Feb 2026
- 2026Context-Aware Counterfactual Data Augmentation for Gender Bias Mitigation in Language Models10 Feb 2026
- 2026After Talking with 1,000 Personas: Learning Preference-Aligned Proactive Assistants From Large-Scale Persona Interactions3 Feb 2026
- 2025Concept Attractors in LLMs and their Applications30 Dec 2025
- 2025SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluation9 Dec 2025
- 2025MoCoRP: Modeling Consistent Relations between Persona and Response for Persona-based Dialogue8 Dec 2025
- 2025ISCA: A Framework for Interview-Style Conversational Agents20 Aug 2025
- 2025Score Before You Speak: Improving Persona Consistency in Dialogue Generation using Response Quality Scores9 Aug 2025
- 2025Dialogue Systems Engineering: A Survey and Future Directions4 Aug 2025
- 2025SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluation12 Jun 2025
- 2025When Large Language Models are Reliable for Judging Empathic Communication11 Jun 2025
- 2025EdgeWisePersona: A Dataset for On-Device User Profiling from Natural Language Interactions16 May 2025
38 more
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Comparing Bottom-Up and Top-Down Steering Approaches on In-Context Learning Tasks11 Nov 2024
- 2024'No' Matters: Out-of-Distribution Detection in Multimodality Long Dialogue31 Oct 2024
- 2024Survey of User Interface Design and Interaction Techniques in Generative AI Applications28 Oct 2024
- 2024Toxic Subword Pruning for Dialogue Response Generation on Large Language Models5 Oct 2024
- 2024Experimental Evaluation of Machine Learning Models for Goal-oriented Customer Service Chatbot with Pipeline Architecture27 Sep 2024
- 2024BotEval: Facilitating Interactive Human Evaluation25 Jul 2024
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Models16 Jul 2024
- 2024Developing Safe and Responsible Large Language Model : Can We Balance Bias Reduction and Language Understanding in Large Language Models?1 Apr 2024
- 2024A Large Collection of Model-generated Contradictory Responses for Consistency-aware Dialogue Systems19 Mar 2024
- 2024MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of Expressions27 Feb 2024
- 2024RecWizard: A Toolkit for Conversational Recommendation with Modular, Portable Models and Interactive User Interface23 Feb 2024
- 2024GrounDial: Human-norm Grounded Safe Dialog Response Generation14 Feb 2024
- 2024Using Natural Language Inference to Improve Persona Extraction from Dialogue in a New Domain12 Jan 2024
- 2024WEBDial, a Multi-domain, Multitask Statistical Dialogue Framework with RDF8 Jan 2024
- 2023Faithful Persona-based Conversational Dataset Generation with Large Language Models15 Dec 2023
- 2023The Claire French Dialogue Dataset28 Nov 2023
- 2023Conversational Data Exploration: A Game-Changer for Designing Data Science Pipelines12 Nov 2023
- 2023Evaluating Generative Ad Hoc Information Retrieval8 Nov 2023
- 2023Learning to love diligent trolls: Accounting for rater effects in the dialogue safety task30 Oct 2023
- 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversations20 Oct 2023
- 2023Character-level Chinese Backpack Language Models19 Oct 2023
- 2023Building Persona Consistent Dialogue Agents with Offline Reinforcement Learning16 Oct 2023
- 2023Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systems8 Oct 2023
- 2023No Offense Taken: Eliciting Offensiveness from Language Models2 Oct 2023
- 2023Towards a Unified Framework for Adaptable Problematic Content Detection via Continual Learning29 Sep 2023
- 2023Foundation Metrics for Evaluating Effectiveness of Healthcare Conversations Powered by Generative AI21 Sep 2023
- 2023Zero-Shot Robustification of Zero-Shot Models8 Sep 2023
- 2023Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversations23 Aug 2023
- 2023A Large Language Model Enhanced Conversational Recommender System11 Aug 2023
- 2023CLEVA: Chinese Language Models EVAluation Platform9 Aug 2023
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI19 Jul 2023
- 2023Training Models to Generate, Recognize, and Reframe Unhelpful Thoughts6 Jul 2023
- 2023X-RiSAWOZ: High-Quality End-to-End Multilingual Dialogue Datasets and Few-shot Agents30 Jun 2023
- 2023Seen to Unseen: Exploring Compositional Generalization of Multi-Attribute Controllable Dialogue Generation17 Jun 2023
- 2023Correction of Errors in Preference Ratings from Automated Metrics for Text Generation6 Jun 2023
- 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Models29 May 2023
- 2023Query-Efficient Black-Box Red Teaming via Bayesian Optimization27 May 2023
50 newest of 139 All 139 (JSON)
- 2023Training Models to Generate, Recognize, and Reframe Unhelpful Thoughtscited by 31
- 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Modelscited by 30
- 2022Improving Chess Commentaries by Combining Language Models with Symbolic Reasoning Enginescited by 12
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Artcited by 7
- 2023Training Models to Generate, Recognize, and Reframe Unhelpful Thoughts6 Jul 2023
- 2023Ask an Expert: Leveraging Language Models to Improve Strategic Reasoning in Goal-Oriented Dialogue Models29 May 2023
- 2023Commonsense Reasoning for Conversational AI: A Survey of the State of the Art15 Feb 2023
- 2022Improving Chess Commentaries by Combining Language Models with Symbolic Reasoning Engines15 Dec 2022
- 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
- 2025SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluationcited by 3
- 2025SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluationcited by 0
- 2025SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluation9 Dec 2025
- 2025SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluation12 Jun 2025
- 2022ProsocialDialog: A Prosocial Backbone for Conversational Agents25 May 2022
- 2023Infusing Commonsense World Models with Graph Knowledgecited by 0
- 2023Infusing Commonsense World Models with Graph Knowledge13 Jan 2023
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
- 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 160
- 2021Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answeringcited by 131
- 2023Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversationscited by 88
- 2022The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialoguescited by 78
- 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
- 2022RankGen: Improving Text Generation with Large Ranking Modelscited by 72
- 2021CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systemscited by 60
- 2022Perturbation Augmentation for Fairer NLPcited by 51
- 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
12 most cited of 127 All 127 (JSON)
- 2026Orcheo: A Modular Full-Stack Platform for Conversational Search16 Feb 2026
- 2026Context-Aware Counterfactual Data Augmentation for Gender Bias Mitigation in Language Models10 Feb 2026
- 2025Concept Attractors in LLMs and their Applications30 Dec 2025
- 2025MoCoRP: Modeling Consistent Relations between Persona and Response for Persona-based Dialogue8 Dec 2025
- 2025ISCA: A Framework for Interview-Style Conversational Agents20 Aug 2025
- 2025Score Before You Speak: Improving Persona Consistency in Dialogue Generation using Response Quality Scores9 Aug 2025
- 2025Dialogue Systems Engineering: A Survey and Future Directions4 Aug 2025
- 2025When Large Language Models are Reliable for Judging Empathic Communication11 Jun 2025
- 2025EdgeWisePersona: A Dataset for On-Device User Profiling from Natural Language Interactions16 May 2025
- 2024Unstructured Text Enhanced Open-domain Dialogue System: A Systematic Survey14 Nov 2024
- 2024Comparing Bottom-Up and Top-Down Steering Approaches on In-Context Learning Tasks11 Nov 2024
- 2024'No' Matters: Out-of-Distribution Detection in Multimodality Long Dialogue31 Oct 2024
12 newest of 127 All 127 (JSON)