Dialogue Natural Language Inference
Not on the map. Why?
Abstract (arXiv)
Consistency is a long standing issue faced by dialogue models. In this paper, we frame the consistency of dialogue agents as natural language inference (NLI) and create a new natural language inference dataset called Dialogue NLI. We propose a method which demonstrates that a model trained on Dialogue NLI can be used to improve the consistency of a dialogue model, and evaluate the method with human evaluation and with automatic metrics on a suite of evaluation sets designed to measure a dialogue model's consistency.
Key facts. Cited by 135 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 37; 2022: 38; 2023: 30; 2024: 20; 2025: 4; 2026: 6.
135 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 156
- 2021Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answeringcited by 132
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVENcited by 124
- 2023Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigationcited by 124
- 2021Entity-level Factual Consistency of Abstractive Text Summarizationcited by 118
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 109
- 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
- 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversationcited by 79
38 more
- 2021Evaluating Attribution in Dialogue Systems: The BEGIN Benchmarkcited by 77
- 2021BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Datacited by 75
- 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
- 2021Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with 1/n Parameterscited by 66
- 2022Investigating Selective Prediction Approaches Across Several Tasks in IID, OOD, and Adversarial Settingscited by 66
- 2021DialFact: A Benchmark for Fact-Checking in Dialoguecited by 62
- 2021DynaEval: Unifying Turn and Dialogue Level Evaluationcited by 59
- 2021AR-LSAT: Investigating Analytical Reasoning of Textcited by 51
- 2022NormSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Flycited by 48
- 2023Faithful Persona-based Conversational Dataset Generation with Large Language Modelscited by 47
- 2021Can NLI Models Verify QA Systems' Predictions?cited by 46
- 2022Model Cascading: Towards Jointly Improving Efficiency and Accuracy of NLP Systemscited by 44
- 2022Enhancing Self-Consistency and Performance of Pre-Trained Language Models through Natural Language Inferencecited by 40
- 2021One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profilescited by 39
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
- 2022Prompt Injection: Parameterization of Fixed Inputscited by 36
- 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
- 2023DetermLR: Augmenting LLM-based Logical Reasoning from Indeterminacy to Determinacycited by 34
- 2022EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Trainingcited by 31
- 2023DialogBench: Evaluating LLMs as Human-like Dialogue Systemscited by 31
- 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challengescited by 31
- 2021Focus Attention: Promoting Faithfulness and Diversity in Summarizationcited by 30
- 2022Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methodscited by 27
- 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Tokencited by 26
- 2022A Model-Agnostic Data Manipulation Method for Persona-based Dialogue Generationcited by 25
- 2022Personalized Dialogue Generation with Persona-Adaptive Attentioncited by 24
- 2023Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Personacited by 24
- 2023MPCHAT: Towards Multimodal Persona-Grounded Conversationcited by 24
- 2021Hi, my name is Martha: Using names to measure and mitigate bias in generative dialogue modelscited by 23
- 2024Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluationscited by 20
- 2021Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understandingcited by 19
- 2023Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignmentcited by 19
- 2021Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue Systemcited by 18
- 2022ILDAE: Instance-Level Difficulty Analysis of Evaluation Datacited by 17
- 2022Learning Dialogue Representations from Consecutive Utterancescited by 17
- 2022Improving Personality Consistency in Conversation by Persona Extendingcited by 17
- 2023Learning to Memorize Entailment and Discourse Relations for Persona-Consistent Dialoguescited by 17
- 2024Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation Datasetcited by 16
50 most cited of 135 All 135 (JSON)
- 2026Truth for Believable AI: Expressed Doubt, Provenance, and Belief Revision as an Engineerable Stance22 Sep 2026
- 2026Controlling and Assessing Appropriate Persona Use in LLM-based Dialogue Generation4 Sep 2026
- 2026When Memory Updates but Behavior Does Not: Repairing Implicit Stale Dependencies in Personalized Agent Responses3 Aug 2026
- 2026Towards Proactive Detection of User-Side Implicit Conflicts in Human-LLM Dialogue22 Jul 2026
- 2026A Heterogeneous Temporal Memory Governance Framework for Long-Term LLM Persona Consistency14 May 2026
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistency26 Mar 2026
- 2025MoCoRP: Modeling Consistent Relations between Persona and Response for Persona-based Dialogue8 Dec 2025
- 2025LOGicalThought: Logic-Based Ontological Grounding of LLMs for High-Assurance Reasoning2 Oct 2025
- 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges17 Feb 2025
- 2025Exploring Persona Sentiment Sensitivity in Personalized Dialogue Generation17 Feb 2025
- 2024A review of faithfulness metrics for hallucination assessment in Large Language Models31 Dec 2024
- 2024Transparent and Coherent Procedural Mistake Detection16 Dec 2024
38 more
- 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Token9 Dec 2024
- 2024A Stack-Propagation Framework for Low-Resource Personalized Dialogue Generation26 Oct 2024
- 2024How Hard is this Test Set? NLI Characterization by Exploiting Training Dynamics4 Oct 2024
- 2024Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations28 May 2024
- 2024CHARP: Conversation History AwaReness Probing for Knowledge-grounded Dialogue Systems24 May 2024
- 2024Red Teaming Language Models for Processing Contradictory Dialogues16 May 2024
- 2024A Survey of Automatic Hallucination Evaluation on Natural Language Generation18 Apr 2024
- 2024DivTOD: Unleashing the Power of LLMs for Diversifying Task-Oriented Dialogue Representations31 Mar 2024
- 2024Knowledge Boundary and Persona Dynamic Shape A Better Social Media Agent28 Mar 2024
- 2024A Large Collection of Model-generated Contradictory Responses for Consistency-aware Dialogue Systems19 Mar 2024
- 2024Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation Dataset7 Mar 2024
- 2024Exploring Continual Learning of Compositional Generalization in NLI7 Mar 2024
- 2024DECIDER: A Dual-System Rule-Controllable Decoding Framework for Language Generation4 Mar 2024
- 2024BootTOD: Bootstrap Task-oriented Dialogue Representations by Aligning Diverse Responses2 Mar 2024
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb 2024
- 2024Commonsense-augmented Memory Construction and Management in Long-term Conversations via Context-aware Persona Refinement25 Jan 2024
- 2024Inconsistent dialogue responses and how to recover from them18 Jan 2024
- 2024Using Natural Language Inference to Improve Persona Extraction from Dialogue in a New Domain12 Jan 2024
- 2023Faithful Persona-based Conversational Dataset Generation with Large Language Models15 Dec 2023
- 2023CESAR: Automatic Induction of Compositional Instructions for Multi-turn Dialogs29 Nov 2023
- 2023DialogBench: Evaluating LLMs as Human-like Dialogue Systems3 Nov 2023
- 2023Blending Reward Functions via Few Expert Demonstrations for Faithful and Accurate Knowledge-Grounded Dialogue Generation2 Nov 2023
- 2023DetermLR: Augmenting LLM-based Logical Reasoning from Indeterminacy to Determinacy28 Oct 2023
- 2023MIRACLE: Towards Personalized Dialogue Generation with Latent-Space Multiple Personal Attribute Control22 Oct 2023
- 2023Contrastive Learning for Inference in Dialogue19 Oct 2023
- 2023Building Persona Consistent Dialogue Agents with Offline Reinforcement Learning16 Oct 2023
- 2023Large Language Models as Source Planner for Personalized Knowledge-grounded Dialogue13 Oct 2023
- 2023Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignment12 Oct 2023
- 2023PICK: Polished & Informed Candidate Scoring for Knowledge-Grounded Dialogue Systems19 Sep 2023
- 2023Leveraging Large Language Models for Automated Dialogue Analysis12 Sep 2023
- 2023Neural Conversation Models and How to Rein Them in: A Survey of Failures and Fixes11 Aug 2023
- 2023PersonaPKT: Building Personalized Dialogue Agents via Parameter-efficient Knowledge Transfer13 Jun 2023
- 2023KNOW How to Make Up Your Mind! Adversarially Detecting and Alleviating Inconsistencies in Natural Language Explanations5 Jun 2023
- 2023MPCHAT: Towards Multimodal Persona-Grounded Conversation27 May 2023
- 2023DKAF: KB Arbitration for Learning Task-Oriented Dialog Systems with Dialog-KB Inconsistencies26 May 2023
- 2023Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigation25 May 2023
- 2023Don't Take This Out of Context! On the Need for Contextual Models and Evaluations for Stylistic Rewriting24 May 2023
- 2023Effortless Integration of Memory Management into Open-Domain Conversation Systems23 May 2023
50 newest of 135 All 135 (JSON)
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2026When Memory Updates but Behavior Does Not: Repairing Implicit Stale Dependencies in Personalized Agent Responsescited by 7
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistencycited by 3
- 2026When Memory Updates but Behavior Does Not: Repairing Implicit Stale Dependencies in Personalized Agent Responses3 Aug 2026
- 2026PICon: A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistency26 Mar 2026
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb 2024
- 2022Prompt Injection: Parameterization of Fixed Inputscited by 36
- 2024Red Teaming Language Models for Processing Contradictory Dialoguescited by 3
- 2024Red Teaming Language Models for Processing Contradictory Dialogues16 May 2024
- 2022Prompt Injection: Parameterization of Fixed Inputs31 May 2022
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2023LM vs LM: Detecting Factual Errors via Cross Examinationcited by 156
- 2021Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answeringcited by 132
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVENcited by 124
- 2023Self-contradictory Hallucinations of Large Language Models: Evaluation, Detection and Mitigationcited by 124
- 2021Entity-level Factual Consistency of Abstractive Text Summarizationcited by 118
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 109
- 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
- 2022AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversationcited by 79
- 2021Evaluating Attribution in Dialogue Systems: The BEGIN Benchmarkcited by 77
12 most cited of 125 All 125 (JSON)
- 2026Truth for Believable AI: Expressed Doubt, Provenance, and Belief Revision as an Engineerable Stance22 Sep 2026
- 2026Controlling and Assessing Appropriate Persona Use in LLM-based Dialogue Generation4 Sep 2026
- 2026Towards Proactive Detection of User-Side Implicit Conflicts in Human-LLM Dialogue22 Jul 2026
- 2026A Heterogeneous Temporal Memory Governance Framework for Long-Term LLM Persona Consistency14 May 2026
- 2025MoCoRP: Modeling Consistent Relations between Persona and Response for Persona-based Dialogue8 Dec 2025
- 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges17 Feb 2025
- 2025Exploring Persona Sentiment Sensitivity in Personalized Dialogue Generation17 Feb 2025
- 2024A review of faithfulness metrics for hallucination assessment in Large Language Models31 Dec 2024
- 2024Transparent and Coherent Procedural Mistake Detection16 Dec 2024
- 2024I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Token9 Dec 2024
- 2024A Stack-Propagation Framework for Low-Resource Personalized Dialogue Generation26 Oct 2024
- 2024How Hard is this Test Set? NLI Characterization by Exploiting Training Dynamics4 Oct 2024
12 newest of 125 All 125 (JSON)