mlsanityData to 7 Oct 2026

A Corpus with Multi-Level Annotations of Patients, Interventions and Outcomes to Support Language Processing for Medical Literature

arXiv 1806.04185 ↗First posted 11 Jun 2018cs.CLcited by 79

Not on the map. Why?

Abstract (arXiv)

We present a corpus of 5,000 richly annotated abstracts of medical articles describing clinical randomized controlled trials. Annotations include demarcations of text spans that describe the Patient population enrolled, the Interventions studied and to what they were Compared, and the Outcomes measured (the `PICO' elements). These spans are further annotated at a more granular level, e.g., individual interventions within them are marked and mapped onto a structured medical vocabulary. We acquired annotations from a diverse set of workers with varying levels of expertise and cost. We describe our data collection process and the corpus itself in detail. We then outline a set of challenging NLP tasks that would aid searching of the medical literature and the practice of evidence-based medicine.

Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jun 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 14; 2022: 11; 2023: 19; 2024: 17; 2025: 6; 2026: 12.

79 papers.

Sort:

By area:

  1. 2022LinkBERT: Pretraining Language Models with Document Linkscited by 209
  2. 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 206
  3. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
  4. 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
  5. 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
  6. 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
  7. 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
  8. 2021Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processingcited by 57
  9. 2023Self-Verification Improves Few-Shot Clinical Information Extractioncited by 52
  10. 2024Towards Evaluating and Building Versatile Large Language Models for Medicinecited by 38
  11. 2024SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Modelscited by 37
  12. 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literaturecited by 37
38 more
  1. 2021Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domainscited by 36
  2. 2022BigBIO: A Framework for Data-Centric Biomedical Natural Language Processingcited by 36
  3. 2023Can large language models replace humans in the systematic review process? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languagescited by 36
  4. 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
  5. 2024A Preliminary Study of o1 in Medicine: Are We Closer to an AI Doctor?cited by 33
  6. 2023Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Modelscited by 32
  7. 2023nach0: Multimodal Natural and Chemical Languages Foundation Modelcited by 26
  8. 2023An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processingcited by 19
  9. 2023Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluationscited by 18
  10. 2021CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understandingcited by 17
  11. 2024Unveiling LLM Evaluation Focused on Metrics: Challenges and Solutionscited by 17
  12. 2024A Comprehensive Survey on Evaluating Large Language Model Applications in the Medical Industrycited by 17
  13. 2023Med-EASi: Finely Annotated Dataset and Models for Controllable Simplification of Medical Textscited by 16
  14. 2023PubMed and Beyond: Biomedical Literature Search in the Age of Artificial Intelligencecited by 16
  15. 2024Large Language Model Benchmarks in Medical Taskscited by 16
  16. 2023UMASS_BioNLP at MEDIQA-Chat 2023: Can LLMs generate high-quality synthetic note-oriented doctor-patient conversations?cited by 14
  17. 2021Crowdsourcing Learning as Domain Adaptation: A Case Study on Named Entity Recognitioncited by 13
  18. 2022RedHOT: A Corpus of Annotated Medical Questions, Experiences, and Claims on Social Mediacited by 13
  19. 2022VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language Understandingcited by 11
  20. 2025Explainability in Practice: A Survey of Explainable NLP Across Various Domainscited by 11
  21. 2023Jointly Extracting Interventions, Outcomes, and Findings from RCT Reports with LLMscited by 10
  22. 2023BioDEX: Large-Scale Biomedical Adverse Drug Event Extraction for Real-World Pharmacovigilancecited by 10
  23. 2022Influence Functions for Sequence Tagging Modelscited by 9
  24. 2024On-the-fly Definition Augmentation of LLMs for Biomedical NERcited by 9
  25. 2024CoDa: Constrained Generation based Data Augmentation for Low-Resource NLPcited by 9
  26. 2024Exploring the use of a Large Language Model for data extraction in systematic reviews: a rapid feasibility studycited by 8
  27. 2022Position-based Prompting for Health Outcome Generationcited by 7
  28. 2021Detect and Classify -- Joint Span Detection and Classification for Health Outcomescited by 6
  29. 2021Deep learning models are not robust against noise in clinical textcited by 6
  30. 2023Several categories of Large Language Models (LLMs): A Short Surveycited by 6
  31. 2024Clinical Insights: A Comprehensive Review of Language Models in Medicinecited by 6
  32. 2023BioAug: Conditional Generation based Data Augmentation for Low-Resource Biomedical NERcited by 5
  33. 2023CARE: Extracting Experimental Findings From Clinical Literaturecited by 5
  34. 2022Enriching Biomedical Knowledge for Low-resource Language Through Large-Scale Translationcited by 4
  35. 2024MedDec: A Dataset for Extracting Medical Decisions from Discharge Summariescited by 4
  36. 2024AlpaPICO: Extraction of PICO Frames from Clinical Trial Documents Using LLMscited by 4
  37. 2021Clinical Evidence Engine: Proof-of-Concept For A Clinical-Domain-Agnostic Decision Support Infrastructurecited by 3
  38. 2021Automated tabulation of clinical trial results: A joint entity and relation extraction approach with transformer-based language representationscited by 3

50 most cited of 79 All 79 (JSON)