mlsanityData to 7 Oct 2026

Overview of the Problem List Summarization (ProbSum) 2023 Shared Task on Summarizing Patients' Active Diagnoses and Problems from Electronic Health Record Progress Notes

arXiv 2306.05270 ↗First posted 8 Jun 2023cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

The BioNLP Workshop 2023 initiated the launch of a shared task on Problem List Summarization (ProbSum) in January 2023. The aim of this shared task is to attract future research efforts in building NLP models for real-world diagnostic decision support applications, where a system generating relevant and accurate diagnoses will augment the healthcare providers decision-making process and improve the quality of care for patients. The goal for participants is to develop models that generated a list of diagnoses and problems using input from the daily care notes collected from the hospitalization of critically ill patients. Eight teams submitted their final systems to the shared task leaderboard. In this paper, we describe the tasks, datasets, evaluation metrics, and baseline systems. Additionally, the techniques and results of the evaluation of the different approaches tried by the participating teams are summarized.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 8 Jun 2023.

Builds on

12 of 36 references.

References · 12

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  6. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  7. 2022Galactica: A Large Language Model for Sciencecited by 736
  8. 2023Do We Still Need Clinical Language Models?cited by 97
  9. 2020Generating SOAP Notes from Doctor-Patient Conversations Using Modular Summarization Techniquescited by 64
  10. 2022Summarizing Patients Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Modelscited by 30
  11. 2022Hierarchical Annotation for Building A Suite of Clinical Natural Language Processing Tasks: Progress Note Understandingcited by 13
  12. 2021A Scoping Review of Publicly Available Language Tasks in Clinical Natural Language Processingcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 1; 2026: 5.

11 papers.

  1. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  2. 2023Leveraging Medical Knowledge Graphs Into Large Language Models for Diagnosis Prediction: Design and Application Studycited by 29
  3. 2025ER-Reason: A Benchmark Dataset for LLM Clinical Reasoning in the Emergency Roomcited by 21
  4. 2024Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: A Benchmark Studycited by 13
  5. 2026Possible or Definite? A Benchmark for Evaluating Diagnostic Uncertainty Preservation in Clinical Textcited by 4
  6. 2024Shimo Lab at "Discharge Me!": Discharge Summarization by Prompt-Driven Concatenation of Electronic Health Record Sectionscited by 3
  7. 2024Query-Guided Self-Supervised Summarization of Nursing Notescited by 0
  8. 2026LogosKG: Hardware-Optimized Scalable and Interpretable Knowledge Graph Retrievalcited by 0
  9. 2026Surgical Alignment in Knowledge Graph Training for Clinical Diagnosis with Large Language Modelscited by 0
  10. 2026EviGen: Predictive Evidence Scaffolding for Verifiable Clinical Rationale Generationcited by 0
  11. 2026Synthetic Hospital: An Open, Verifiable, Physician-Validated Longitudinal EHR Benchmarkcited by 0