mlsanityData to 7 Oct 2026

Learn to Resolve Conversational Dependency: A Consistency Training Framework for Conversational Question Answering

arXiv 2106.11575 ↗First posted 22 Jun 2021cs.CL cs.AIcited by 27

Not on the map. Why?

Abstract (arXiv)

One of the main challenges in conversational question answering (CQA) is to resolve the conversational dependency, such as anaphora and ellipsis. However, existing approaches do not explicitly train QA models on how to resolve the dependency, and thus these models are limited in understanding human dialogues. In this paper, we propose a novel framework, ExCorD (Explicit guidance on how to resolve Conversational Dependency) to enhance the abilities of QA models in comprehending conversational context. ExCorD first generates self-contained questions that can be understood without the conversation history, then trains a QA model with the pairs of original and self-contained questions using a consistency-based regularizer. In our experiments, we demonstrate that ExCorD significantly improves the QA models' performance by up to 1.2 F1 on QuAC, and 5.2 F1 on CANARD, while addressing the limitations of the existing approaches.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 22 Jun 2021.

Builds on

34 of 42 references.

References · 34

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  5. 2018Hierarchical Neural Story Generationcited by 1,182
  6. 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,057
  7. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
  8. 2017Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learningcited by 918
  9. 2018CoQA: A Conversational Question Answering Challengecited by 674
  10. 2016Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learningcited by 441
  11. 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
  12. 2018QuAC : Question Answering in Contextcited by 379
22 more
  1. 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
  2. 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 253
  3. 2018Higher-order Coreference Resolution with Coarse-to-fine Inferencecited by 150
  4. 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 147
  5. 2020Open-Retrieval Conversational Question Answeringcited by 99
  6. 2020Question Rewriting for Conversational Question Answeringcited by 93
  7. 2020Logic-Guided Data Augmentation and Regularization for Consistent Question Answeringcited by 77
  8. 2018Semi-Supervised Sequence Modeling with Cross-View Trainingcited by 75
  9. 2019BERT with History Answer Embedding for Conversational Question Answeringcited by 67
  10. 2020Conversational Question Reformulation via Sequence-to-Sequence Architectures and Pretrained Language Modelscited by 45
  11. 2017Ask the Right Questions: Active Question Reformulation with Reinforcement Learningcited by 44
  12. 2019GraphFlow: Exploiting Conversation Flow with Graph Neural Networks for Conversational Machine Comprehensioncited by 41
  13. 2018FlowQA: Grasping Flow in History for Conversational Machine Comprehensioncited by 33
  14. 2019Attentive History Selection for Conversational Question Answeringcited by 33
  15. 2018SDNet: Contextualized Attention-based Deep Network for Conversational Question Answeringcited by 30
  16. 2018Improving Machine Reading Comprehension with General Reading Strategiescited by 20
  17. 2019FlowDelta: Modeling Flow Information Gain in Reasoning for Conversational Machine Comprehensioncited by 19
  18. 2020Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Spacecited by 19
  19. 2019A Simple but Effective Method to Incorporate Multi-turn Context with BERT for Conversational Machine Comprehensioncited by 18
  20. 2019Technical report on Conversational Question Answeringcited by 18
  21. 2019Learning to Ask Unanswerable Questions for Machine Reading Comprehensioncited by 9
  22. 2021Consistency Training with Virtual Adversarial Discrete Perturbationcited by 9

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 10; 2023: 11; 2024: 2; 2025: 3.

27 papers.

Sort:

By area:

  1. 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
  2. 2023Consistency Analysis of ChatGPTcited by 37
  3. 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Surveycited by 22
  4. 2021Ditch the Gold Standard: Re-evaluating Conversational Question Answeringcited by 19
  5. 2022Reinforced Question Rewriting for Conversational Question Answeringcited by 19
  6. 2022Saving Dense Retriever from Shortcut Dependency in Conversational Searchcited by 18
  7. 2022Generating Information-Seeking Conversations from Unlabeled Documentscited by 17
  8. 2022Improving the Sample Efficiency of Prompt Tuning with Domain Adaptationcited by 15
  9. 2022On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Methodcited by 12
  10. 2022CQR-SQL: Conversational Question Reformulation Enhanced Context-Dependent Text-to-SQL Parserscited by 11
  11. 2024The Imperative of Conversation Analysis in the Era of LLMs: A Survey of Tasks, Techniques, and Trendscited by 11
  12. 2022Can Question Rewriting Help Conversational Question Answering?cited by 8
15 more
  1. 2023Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generationcited by 7
  2. 2023PCoQA: Persian Conversational Question Answering Datasetcited by 5
  3. 2022SCAI-QReCC Shared Task on Conversational Question Answeringcited by 4
  4. 2023Learning to Select the Relevant History Turns in Conversational Question Answeringcited by 4
  5. 2023Improving Language Models Meaning Understanding and Consistency by Learning Conceptual Roles from Dictionarycited by 4
  6. 2023Keeping the Questions Conversational: Using Structured Representations to Resolve Dependency in Conversational Question Answeringcited by 3
  7. 2025Towards Adaptive Context Management for Intelligent Conversational Question Answeringcited by 3
  8. 2023Realistic Conversational Question Answering with Answer Selection based on Calibrated Confidence and Uncertainty Measurementcited by 2
  9. 2023Phrase Retrieval for Open-Domain Conversational Question Answering with Conversational Dependency Modeling via Contrastive Learningcited by 2
  10. 2024Consistency Training by Synthetic Question Generation for Conversational Question Answeringcited by 2
  11. 2025Adaptive Multi-Agent Response Refinement in Conversational Systemscited by 2
  12. 2023Orca: A Few-shot Benchmark for Chinese Conversational Machine Reading Comprehensioncited by 1
  13. 2023QURG: Question Rewriting Guided Context-Dependent Text-to-SQL Semantic Parsingcited by 1
  14. 2023Prompt Guided Copy Mechanism for Conversational Question Answeringcited by 1
  15. 2025A Survey of the State-of-the-Art in Conversational Question Answering Systemscited by 1