mlsanityData to 14 Oct 2026

Overview of the First Shared Task on Clinical Text Generation: RRG24 and "Discharge Me!"

arXiv 2409.16603 ↗First posted 25 Sep 2024cs.CLcited by 20

Not on the map. Why?

Abstract (arXiv)

Recent developments in natural language generation have tremendous implications for healthcare. For instance, state-of-the-art systems could automate the generation of sections in clinical reports to alleviate physician workload and streamline hospital documentation. To explore these applications, we present a shared task consisting of two subtasks: (1) Radiology Report Generation (RRG24) and (2) Discharge Summary Generation ("Discharge Me!"). RRG24 involves generating the 'Findings' and 'Impression' sections of radiology reports given chest X-rays. "Discharge Me!" involves generating the 'Brief Hospital Course' and 'Discharge Instructions' sections of discharge summaries for patients admitted through the emergency department. "Discharge Me!" submissions were subsequently reviewed by a team of clinicians. Both tasks emphasize the goal of reducing clinician burnout and repetitive workloads by generating documentation. We received 201 submissions from across 8 teams for RRG24, and 211 submissions from across 16 teams for "Discharge Me!".

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 35 of its 86 references that are in the map. First posted on arXiv 25 Sep 2024.

Builds on

35 of 86 references.

References · 35

  1. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  2. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  3. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  4. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  5. 2020Generating Radiology Reports via Memory-driven Transformercited by 368
  6. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 337
  7. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 309
  8. 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
  9. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 246
  10. 2017On the Automatic Generation of Medical Imaging Reportscited by 216
  11. 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 163
  12. 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 162
23 more
  1. 2020When Radiology Report Generation Meets Knowledge Graphcited by 145
  2. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 128
  3. 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
  4. 2022Improving the Factual Correctness of Radiology Report Generation with Semantic Rewardscited by 83
  5. 2020BIMCV COVID-19+: a large annotated dataset of RX and CT images from COVID-19 patientscited by 82
  6. 2023MAIRA-1: A specialised large multimodal model for radiology report generationcited by 74
  7. 2021Codabench: Flexible, Easy-to-Use and Reproducible Benchmarking Platformcited by 66
  8. 2016Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotationcited by 59
  9. 2017MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Networkcited by 56
  10. 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoningcited by 42
  11. 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
  12. 2022Learning to Revise References for Faithful Summarizationcited by 28
  13. 2024e-Health CSIRO at RRG24: Entropy-Augmented Self-Critical Sequence Training for Radiology Report Generationcited by 10
  14. 2023What are the Desired Characteristics of Calibration Sets? Identifying Correlates on Long Form Scientific Summarizationcited by 8
  15. 2023A Method to Automate the Discharge Summary Hospital Course for Neurology Patientscited by 6
  16. 2024WisPerMed at "Discharge Me!": Advancing Text Generation in Healthcare with Large Language Models, Dynamic Expert Selection, and Priming Techniques on MIMIC-IVcited by 6
  17. 2023Breast Ultrasound Report Generation using LangChaincited by 5
  18. 2024SPEER: Sentence-Level Planning of Long Clinical Summaries via Embedded Entity Retrievalcited by 5
  19. 2024QUB-Cirdan at "Discharge Me!": Zero shot discharge letter generation by open-source LLMcited by 4
  20. 2024Shimo Lab at "Discharge Me!": Discharge Summarization by Prompt-Driven Concatenation of Electronic Health Record Sectionscited by 4
  21. 2024e-Health CSIRO at "Discharge Me!" 2024: Generating Discharge Summary Sections with Fine-tuned Language Modelscited by 4
  22. 2024UF-HOBI at "Discharge Me!": A Hybrid Solution for Discharge Summary Generation Through Prompt-based Tuning of GatorTronGPT Modelscited by 4
  23. 2024IgnitionInnovators at "Discharge Me!": Chain-of-Thought Instruction Finetuning Large Language Models for Discharge Summariescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 12.

20 papers.

Sort:

By area:

  1. 2025RadEval: A framework for radiology text evaluationcited by 22
  2. 2024Gla-AI4BioMed at RRG24: Visual Instruction-tuned Adaptation for Radiology Report Generationcited by 4
  3. 2026Possible or Definite? A Benchmark for Evaluating Diagnostic Uncertainty Preservation in Clinical Textcited by 4
  4. 2025Natural Language Generation in Healthcare: A Review of Methods and Applicationscited by 3
  5. 2025Large Language Model-Based Generation of Discharge Summariescited by 2
  6. 2025Towards Conditioning Clinical Text Generation for User Controlcited by 1
  7. 2025Random Direct Preference Optimization for Radiography Report Generationcited by 1
  8. 2026FairLLaVA: Fairness-Aware Parameter-Efficient Fine-Tuning for Large Vision-Language Assistantscited by 1
  9. 2026CuraView: A Multi-Agent Framework for Medical Hallucination Detection with GraphRAG-Enhanced Knowledge Verificationcited by 1
  10. 2026From Triage to Discharge: A Survey of NLP Tasks, Methods, and Open Challenges in the Emergency Departmentcited by 1
  11. 2025LCDS: A Logic-Controlled Discharge Summary Generation System Supporting Source Attribution and Expert Reviewcited by 0
  12. 2025HARE: an entity and relation centric evaluation framework for histopathology reportscited by 0
8 more
  1. 2026WeNLEX: Weakly Supervised Natural Language Explanations for Multilabel Chest X-ray Classificationcited by 0
  2. 2026Ran Score: a LLM-based Evaluation Score for Radiology Report Generationcited by 0
  3. 2026CareTransition-Audit: A Benchmark to Audit Discharge Summaries for Efficient Care Transitionscited by 0
  4. 2026Systematic Evaluation of the Quality of Synthetic Clinical Notes Rephrased by LLMs at Million-Note Scalecited by 0
  5. 2026CARE-X: Towards Clinically Useful Radiology VLMs with Auxiliary Supervision, Reward-Aligned Learning, and Tool-Augmented Measurementcited by 0
  6. 2026Adaptive Arena-based Contestable Argumentative Network-of-Experts for Open-Ended Care Plan Coordinationcited by 0
  7. 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studiescited by 0
  8. 2026Hidden Data Challenges in Clinical Machine Learningcited by 0