mlsanityData to 7 Oct 2026

CliCR: A Dataset of Clinical Case Reports for Machine Reading Comprehension

arXiv 1803.09720 ↗First posted 26 Mar 2018cs.CLcited by 34

Not on the map. Why?

Abstract (arXiv)

We present a new dataset for machine comprehension in the medical domain. Our dataset uses clinical case reports with around 100,000 gap-filling queries about these cases. We apply several baselines and state-of-the-art neural readers to the dataset, and observe a considerable gap in performance (20% F1) between the best human and machine readers. We analyze the skills required for successful answering and show how reader performance varies depending on the applicable skills. We find that inferences using domain knowledge and object tracking are the most frequently required skills, and that recognizing omitted information and spatio-temporal reasoning are the most difficult for the machines.

Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Mar 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 9; 2022: 9; 2023: 7; 2024: 7; 2025: 2.

34 papers.

Sort:

  1. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  2. 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
  3. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  4. 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 113
  5. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  6. 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 90
  7. 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
  8. 2023Towards Mitigating Hallucination in Large Language Models via Self-Reflectioncited by 81
  9. 2024SPIQA: A Dataset for Multimodal Question Answering on Scientific Paperscited by 75
  10. 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
  11. 2023Huatuo-26M, a Large-scale Chinese Medical QA Datasetcited by 46
  12. 2024A Survey of Prompt Engineering Methods in Large Language Models for Different NLP Taskscited by 46
22 more
  1. 2021AMMU : A Survey of Transformer-based Biomedical Pretrained Language Modelscited by 32
  2. 2021Conversational Question Answering: A Surveycited by 31
  3. 2021English Machine Reading Comprehension Datasets: A Surveycited by 26
  4. 2022Modern Question Answering Datasets and Benchmarks: A Surveycited by 23
  5. 2022DrugEHRQA: A Question Answering Dataset on Structured and Unstructured Electronic Health Records For Medicine Related Queriescited by 17
  6. 2022Learning to Ask Like a Physiciancited by 16
  7. 2024Large Language Model Benchmarks in Medical Taskscited by 16
  8. 2021Question Answering for Complex Electronic Health Records Database using Unified Encoder-Decoder Architecturecited by 9
  9. 2024SyllabusQA: A Course Logistics Question Answering Datasetcited by 9
  10. 2023Question Answering for Electronic Health Records: A Scoping Review of datasets and modelscited by 7
  11. 2022SPBERTQA: A Two-Stage Question Answering System Based on Sentence Transformers for Medical Textscited by 5
  12. 2022To Adapt or to Annotate: Challenges and Interventions for Domain Adaptation in Open-Domain Question Answeringcited by 5
  13. 2021Attention-based Aspect Reasoning for Knowledge Base Question Answering on Clinical Notescited by 4
  14. 2022Uncertainty-Aware Text-to-Program for Question Answering on Structured Electronic Health Recordscited by 4
  15. 2024SA-MDKIF: A Scalable and Adaptable Medical Domain Knowledge Injection Framework for Large Language Modelscited by 2
  16. 2024Can GPT Redefine Medical Understanding? Evaluating GPT on Biomedical Machine Reading Comprehensioncited by 1
  17. 2022Multi Document Reading Comprehensioncited by 0
  18. 2022InDEX: Indonesian Idiom and Expression Dataset for Cloze Testcited by 0
  19. 2023Fine-tuning pre-trained extractive QA models for clinical document parsingcited by 0
  20. 2024Recent Advances in Multi-Choice Machine Reading Comprehension: A Survey on Methods and Datasetscited by 0
  21. 2025End-to-End Dialog Neural Coreference Resolution: Balancing Efficiency and Accuracy in Large-Scale Systemscited by 0
  22. 2025Investigating LLM Capabilities on Long Context Comprehension for Medical Question Answeringcited by 0