mlsanityData to 7 Oct 2026

CoQA: A Conversational Question Answering Challenge

arXiv 1808.07042 ↗First posted 21 Aug 2018cs.CL cs.AI cs.LGcited by 674

Not on the map. Why?

Cited by 34 in Retrieval-augmented generation, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Humans gather information by engaging in conversations involving a series of interconnected questions and answers. For machines to assist in information gathering, it is therefore essential to enable them to answer conversational questions. We introduce CoQA, a novel dataset for building Conversational Question Answering systems. Our dataset contains 127k questions with answers, obtained from 8k conversations about text passages from seven diverse domains. The questions are conversational, and the answers are free-form text with their corresponding evidence highlighted in the passage. We analyze CoQA in depth and show that conversational questions have challenging phenomena not present in existing reading comprehension datasets, e.g., coreference and pragmatic reasoning. We evaluate strong conversational and reading comprehension models on CoQA. The best system obtains an F1 score of 65.4%, which is 23.4 points behind human performance (88.8%), indicating there is ample room for improvement. We launch CoQA as a challenge to the community at http://stanfordnlp.github.io/coqa/

Key facts. Cited by 674 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Aug 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 99; 2022: 95; 2023: 104; 2024: 137; 2025: 141; 2026: 98.

674 papers.

Sort:

By area:

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  5. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  6. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
  7. 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
  8. 2023StarCoder: may the source be with you!cited by 790
  9. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  10. 2023A Comprehensive Overview of Large Language Modelscited by 639
  11. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  12. 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 490
38 more
  1. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
  2. 2025Humanity's Last Examcited by 467
  3. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 449
  4. 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
  5. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 409
  6. 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
  7. 2024ShortGPT: Layers in Large Language Models are More Redundant Than You Expectcited by 369
  8. 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 317
  9. 2023PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimizationcited by 311
  10. 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 286
  11. 2023Think before you speak: Training Language Models With Pause Tokenscited by 254
  12. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  13. 2022OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalizationcited by 235
  14. 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
  15. 2025Reasoning with Latent Thoughts: On the Power of Looped Transformerscited by 223
  16. 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 199
  17. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
  18. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
  19. 2023Don't Make Your LLM an Evaluation Benchmark Cheatercited by 194
  20. 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
  21. 2021FeTaQA: Free-form Table Question Answeringcited by 174
  22. 2024Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuningcited by 174
  23. 2023Benchmarking Foundation Models with Language-Model-as-an-Examinercited by 172
  24. 2023Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Lawscited by 155
  25. 2023Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answeringcited by 150
  26. 2023Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Modelscited by 147
  27. 2023Inspecting and Editing Knowledge Representations in Language Modelscited by 140
  28. 2021FedScale: Benchmarking Model and System Performance of Federated Learning at Scalecited by 135
  29. 2021Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformercited by 134
  30. 2023LM-Polygraph: Uncertainty Estimation for Language Modelscited by 130
  31. 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
  32. 2024xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Tokencited by 123
  33. 2024MiniCache: KV Cache Compression in Depth Dimension for Large Language Modelscited by 122
  34. 2023AutoMix: Automatically Mixing Language Modelscited by 116
  35. 2024Know Your Limits: A Survey of Abstention in Large Language Modelscited by 116
  36. 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 115
  37. 2024A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directionscited by 115
  38. 2024MagicPIG: LSH Sampling for Efficient LLM Generationcited by 112

50 most cited of 674 All 674 (JSON)