mlsanityData to 14 Oct 2026

ConditionalQA: A Complex Reading Comprehension Dataset with Conditional Answers

arXiv 2110.06884 ↗First posted 13 Oct 2021cs.CL cs.AIcited by 29

Not on the map. Why?

Abstract (arXiv)

We describe a Question Answering (QA) dataset that contains complex questions with conditional answers, i.e. the answers are only applicable when certain conditions apply. We call this dataset ConditionalQA. In addition to conditional answers, the dataset also features: (1) long context documents with information that is related in logically complex ways; (2) multi-hop questions that require compositional logical reasoning; (3) a combination of extractive questions, yes/no questions, questions with multiple answers, and not-answerable questions; (4) questions asked without knowing the answers. We show that ConditionalQA is challenging for many of the existing QA models, especially in selecting answer conditions. We believe that this dataset will motivate further research in answering complex questions over long documents. Data and leaderboard are publicly available at urlhttps://github.com/haitian-sun/ConditionalQA.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 13 Oct 2021.

Builds on

26 of 30 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  5. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  6. 2020Longformer: The Long-Document Transformercited by 3,413
  7. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  8. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  9. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  10. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  11. 2020TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languagescited by 488
  12. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
14 more
  1. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 410
  2. 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 390
  3. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 296
  4. 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 264
  5. 2017Constructing Datasets for Multi-hop Reading Comprehension Across Documentscited by 190
  6. 2015The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systemscited by 172
  7. 2021A Dataset for Answering Time-Sensitive Questionscited by 154
  8. 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
  9. 2018Interpretation of Natural Language Rules in Conversational Machine Readingcited by 75
  10. 2019Question Answering for Privacy Policies: Combining Computational and Legal Perspectivescited by 67
  11. 2020IIRC: A Dataset of Incomplete Information Reading Comprehension Questionscited by 53
  12. 2020Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledgecited by 37
  13. 2020PolicyQA: A Reading Comprehension Dataset for Privacy Policiescited by 34
  14. 2021Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Studycited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 5; 2023: 6; 2024: 12; 2025: 4; 2026: 2.

29 papers.

Sort:

By area:

  1. 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 234
  2. 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 201
  3. 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
  4. 2023PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documentscited by 61
  5. 2023BoardgameQA: A Dataset for Natural Language Reasoning with Contradictory Informationcited by 44
  6. 2024Is Semantic Chunking Worth the Computational Cost?cited by 43
  7. 2024Training Language Models to Generate Text with Citations via Fine-grained Rewardscited by 42
  8. 2024DOCBENCH: A Benchmark for Evaluating LLM-based Document Reading Systemscited by 37
  9. 2022Task Ambiguity in Humans and Language Modelscited by 28
  10. 2025Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluationcited by 28
  11. 2022INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactionscited by 27
  12. 2022Modern Question Answering Datasets and Benchmarks: A Surveycited by 23
17 more
  1. 2025PeerQA: A Scientific Question Answering Dataset from Peer Reviewscited by 22
  2. 2024TrustSQL: Benchmarking Text-to-SQL Reliability with Penalty-Based Scoringcited by 17
  3. 2024Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMscited by 12
  4. 2023Learning Representations of Bi-level Knowledge Graphs for Reasoning beyond Link Predictioncited by 9
  5. 2024textttMixGR: Enhancing Retriever Generalization for Scientific Domain through Complementary Granularitycited by 9
  6. 2024"I Never Said That": A dataset, taxonomy and baselines on response clarity classificationcited by 9
  7. 2025A Neurosymbolic Approach to Natural Language Formalization and Verificationcited by 9
  8. 2023Answering Ambiguous Questions with a Database of Questions, Answers, and Revisionscited by 4
  9. 2022Reasoning over Logically Interacted Conditions for Question Answeringcited by 3
  10. 2023Towards leveraging LLMs for Conditional QAcited by 2
  11. 2024Can Your Model Tell a Negation from an Implicature? Unravelling Challenges With Intent Encoderscited by 2
  12. 2025Improving Factuality in LLMs via Inference-Time Knowledge Graph Constructioncited by 2
  13. 2024Chain of Condition: Construct, Verify and Solve Conditions for Conditional Question Answeringcited by 1
  14. 2024Revealing Trends in Datasets from the 2022 ACL and EMNLP Conferencescited by 0
  15. 2024Structured List-Grounded Question Answeringcited by 0
  16. 2026KGCaRe: Explainable Complex Conditional Question Answering using Automatic Knowledge Graph Construction and Context Retrieval with LLMscited by 0
  17. 2026Is This Evidence Decision-Critical? Learning to Verify Rule-Governed Decisionscited by 0