Learn to Resolve Conversational Dependency: A Consistency Training Framework for Conversational Question Answering
Not on the map. Why?
Abstract (arXiv)
One of the main challenges in conversational question answering (CQA) is to resolve the conversational dependency, such as anaphora and ellipsis. However, existing approaches do not explicitly train QA models on how to resolve the dependency, and thus these models are limited in understanding human dialogues. In this paper, we propose a novel framework, ExCorD (Explicit guidance on how to resolve Conversational Dependency) to enhance the abilities of QA models in comprehending conversational context. ExCorD first generates self-contained questions that can be understood without the conversation history, then trains a QA model with the pairs of original and self-contained questions using a consistency-based regularizer. In our experiments, we demonstrate that ExCorD significantly improves the QA models' performance by up to 1.2 F1 on QuAC, and 5.2 F1 on CANARD, while addressing the limitations of the existing approaches.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 22 Jun 2021.
Builds on
34 of 42 references.
References · 34
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2018Hierarchical Neural Story Generationcited by 1,182
- 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,057
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
- 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
- 2018CoQA: A Conversational Question Answering Challengecited by 674
- 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
- 2018QuAC : Question Answering in Contextcited by 379
22 more
- 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
- 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 253
- 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
- 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 147
- 2020Open-Retrieval Conversational Question Answeringcited by 99
- 2020Question Rewriting for Conversational Question Answeringcited by 93
- 2020Logic-Guided Data Augmentation and Regularization for Consistent Question Answeringcited by 77
- 2018Semi-Supervised Sequence Modeling with Cross-View Trainingcited by 75
- 2019BERT with History Answer Embedding for Conversational Question Answeringcited by 67
- 2020Conversational Question Reformulation via Sequence-to-Sequence Architectures and Pretrained Language Modelscited by 45
- 2017Ask the Right Questions: Active Question Reformulation with Reinforcement Learningcited by 44
- 2019GraphFlow: Exploiting Conversation Flow with Graph Neural Networks for Conversational Machine Comprehensioncited by 41
- 2018FlowQA: Grasping Flow in History for Conversational Machine Comprehensioncited by 33
- 2019Attentive History Selection for Conversational Question Answeringcited by 33
- 2018SDNet: Contextualized Attention-based Deep Network for Conversational Question Answeringcited by 30
- 2018Improving Machine Reading Comprehension with General Reading Strategiescited by 20
- 2019FlowDelta: Modeling Flow Information Gain in Reasoning for Conversational Machine Comprehensioncited by 19
- 2020Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Spacecited by 19
- 2019A Simple but Effective Method to Incorporate Multi-turn Context with BERT for Conversational Machine Comprehensioncited by 18
- 2019Technical report on Conversational Question Answeringcited by 18
- 2019Learning to Ask Unanswerable Questions for Machine Reading Comprehensioncited by 9
- 2021Consistency Training with Virtual Adversarial Discrete Perturbationcited by 9
Built on by
Citing papers per year: 2021: 1; 2022: 10; 2023: 11; 2024: 2; 2025: 3.
27 papers.
Sort:
By area:
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
- 2023Consistency Analysis of ChatGPTcited by 37
- 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Surveycited by 22
- 2021Ditch the Gold Standard: Re-evaluating Conversational Question Answeringcited by 19
- 2022Reinforced Question Rewriting for Conversational Question Answeringcited by 19
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Searchcited by 18
- 2022Generating Information-Seeking Conversations from Unlabeled Documentscited by 17
- 2022Improving the Sample Efficiency of Prompt Tuning with Domain Adaptationcited by 15
- 2022On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Methodcited by 12
- 2022CQR-SQL: Conversational Question Reformulation Enhanced Context-Dependent Text-to-SQL Parserscited by 11
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trendscited by 11
- 2022Can Question Rewriting Help Conversational Question Answering?cited by 8
15 more
- 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generationcited by 7
- 2023PCoQA: Persian Conversational Question Answering Datasetcited by 5
- 2022SCAI-QReCC Shared Task on Conversational Question Answeringcited by 4
- 2023Learning to Select the Relevant History Turns in Conversational Question Answeringcited by 4
- 2023Improving Language Models Meaning Understanding and Consistency by Learning Conceptual Roles from Dictionarycited by 4
- 2023Keeping the Questions Conversational: Using Structured Representations to Resolve Dependency in Conversational Question Answeringcited by 3
- 2025Towards Adaptive Context Management for Intelligent Conversational Question Answeringcited by 3
- 2023Realistic Conversational Question Answering with Answer Selection based on Calibrated Confidence and Uncertainty Measurementcited by 2
- 2023Phrase Retrieval for Open-Domain Conversational Question Answering with Conversational Dependency Modeling via Contrastive Learningcited by 2
- 2024Consistency Training by Synthetic Question Generation for Conversational Question Answeringcited by 2
- 2025Adaptive Multi-Agent Response Refinement in Conversational Systemscited by 2
- 2023Orca: A Few-shot Benchmark for Chinese Conversational Machine Reading Comprehensioncited by 1
- 2023QURG: Question Rewriting Guided Context-Dependent Text-to-SQL Semantic Parsingcited by 1
- 2023Prompt Guided Copy Mechanism for Conversational Question Answeringcited by 1
- 2025A Survey of the State-of-the-Art in Conversational Question Answering Systemscited by 1
- 2025Adaptive Multi-Agent Response Refinement in Conversational Systems11 Nov 2025
- 2025Towards Adaptive Context Management for Intelligent Conversational Question Answering22 Sep 2025
- 2025A Survey of the State-of-the-Art in Conversational Question Answering Systems6 Sep 2025
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trends21 Sep 2024
- 2024Consistency Training by Synthetic Question Generation for Conversational Question Answering17 Apr 2024
- 2023PCoQA: Persian Conversational Question Answering Dataset7 Dec 2023
- 2023Improving Language Models Meaning Understanding and Consistency by Learning Conceptual Roles from Dictionary24 Oct 2023
- 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generation20 Oct 2023
- 2023Prompt Guided Copy Mechanism for Conversational Question Answering7 Aug 2023
- 2023Learning to Select the Relevant History Turns in Conversational Question Answering4 Aug 2023
- 2023Phrase Retrieval for Open-Domain Conversational Question Answering with Conversational Dependency Modeling via Contrastive Learning7 Jun 2023
- 2023QURG: Question Rewriting Guided Context-Dependent Text-to-SQL Semantic Parsing11 May 2023
15 more
- 2023Keeping the Questions Conversational: Using Structured Representations to Resolve Dependency in Conversational Question Answering14 Apr 2023
- 2023Consistency Analysis of ChatGPT11 Mar 2023
- 2023Orca: A Few-shot Benchmark for Chinese Conversational Machine Reading Comprehension27 Feb 2023
- 2023Realistic Conversational Question Answering with Answer Selection based on Calibrated Confidence and Uncertainty Measurement10 Feb 2023
- 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Survey6 Nov 2022
- 2022Reinforced Question Rewriting for Conversational Question Answering27 Oct 2022
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Finance17 Oct 2022
- 2022Improving the Sample Efficiency of Prompt Tuning with Domain Adaptation6 Oct 2022
- 2022On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Method29 Jun 2022
- 2022Generating Information-Seeking Conversations from Unlabeled Documents25 May 2022
- 2022CQR-SQL: Conversational Question Reformulation Enhanced Context-Dependent Text-to-SQL Parsers16 May 2022
- 2022Can Question Rewriting Help Conversational Question Answering?13 Apr 2022
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Search15 Feb 2022
- 2022SCAI-QReCC Shared Task on Conversational Question Answering26 Jan 2022
- 2021Ditch the Gold Standard: Re-evaluating Conversational Question Answering16 Dec 2021
- 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
- 2023Consistency Analysis of ChatGPTcited by 37
- 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Surveycited by 22
- 2021Ditch the Gold Standard: Re-evaluating Conversational Question Answeringcited by 19
- 2022Reinforced Question Rewriting for Conversational Question Answeringcited by 19
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Searchcited by 18
- 2022Generating Information-Seeking Conversations from Unlabeled Documentscited by 17
- 2022Improving the Sample Efficiency of Prompt Tuning with Domain Adaptationcited by 15
- 2022On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Methodcited by 12
- 2022CQR-SQL: Conversational Question Reformulation Enhanced Context-Dependent Text-to-SQL Parserscited by 11
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trendscited by 11
- 2022Can Question Rewriting Help Conversational Question Answering?cited by 8
12 most cited of 26 All 26 (JSON)
- 2025Towards Adaptive Context Management for Intelligent Conversational Question Answering22 Sep 2025
- 2025A Survey of the State-of-the-Art in Conversational Question Answering Systems6 Sep 2025
- 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trends21 Sep 2024
- 2024Consistency Training by Synthetic Question Generation for Conversational Question Answering17 Apr 2024
- 2023PCoQA: Persian Conversational Question Answering Dataset7 Dec 2023
- 2023Improving Language Models Meaning Understanding and Consistency by Learning Conceptual Roles from Dictionary24 Oct 2023
- 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generation20 Oct 2023
- 2023Prompt Guided Copy Mechanism for Conversational Question Answering7 Aug 2023
- 2023Learning to Select the Relevant History Turns in Conversational Question Answering4 Aug 2023
- 2023Phrase Retrieval for Open-Domain Conversational Question Answering with Conversational Dependency Modeling via Contrastive Learning7 Jun 2023
- 2023QURG: Question Rewriting Guided Context-Dependent Text-to-SQL Semantic Parsing11 May 2023
- 2023Keeping the Questions Conversational: Using Structured Representations to Resolve Dependency in Conversational Question Answering14 Apr 2023
12 newest of 26 All 26 (JSON)