Leveraging Summary Guidance on Medical Report Summarization
Not on the map. Why?
Abstract (arXiv)
This study presents three deidentified large medical text datasets, named DISCHARGE, ECHO and RADIOLOGY, which contain 50K, 16K and 378K pairs of report and summary that are derived from MIMIC-III, respectively. We implement convincing baselines of automated abstractive summarization on the proposed datasets with pre-trained encoder-decoder language models, including BERT2BERT, T5-large and BART. Further, based on the BART model, we leverage the sampled summaries from the train set as prior knowledge guidance, for encoding additional contextual representations of the guidance with the encoder and enhancing the decoding representations in the decoder. The experimental results confirm the improvement of ROUGE scores and BERTScore made by the proposed method, outperforming the larger model T5-large.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 30 of its 61 references that are in the map. First posted on arXiv 8 Feb 2023.
Builds on
30 of 61 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
- 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
- 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
- 2019Text Summarization with Pretrained Encoderscited by 556
18 more
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
- 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 244
- 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 222
- 2017On the Automatic Generation of Medical Imaging Reportscited by 216
- 2019Leveraging Pre-trained Checkpoints for Sequence Generation Taskscited by 182
- 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 162
- 2020GSum: A General Framework for Guided Neural Abstractive Summarizationcited by 129
- 2020Factual Error Correction for Abstractive Summarization Modelscited by 108
- 2019Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generationcited by 102
- 2019Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reportscited by 96
- 2021Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Trainingcited by 96
- 2018Learning to Summarize Radiology Findingscited by 54
- 2022FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarizationcited by 49
- 2018Natural Language Generation for Electronic Health Recordscited by 27
- 2022Towards Improving Faithfulness in Abstractive Summarizationcited by 27
- 2021Automated Generation of Accurate & Fluent Medical X-ray Reportscited by 24
- 2021Towards Clinical Encounter Summarization: Learning to Compose Discharge Summaries from Prior Notescited by 19
- 2022Salience Allocation as Guidance for Abstractive Summarizationcited by 14
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 1; 2026: 1.
8 papers.
- 2023Context Aware Query Rewriting for Text Rankers using LLMcited by 14
- 2024Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: A Benchmark Studycited by 13
- 2023Query Understanding in the Age of Large Language Modelscited by 7
- 2024CTISum: A New Benchmark Dataset For Cyber Threat Intelligence Summarizationcited by 2
- 2025Large Language Model-Based Generation of Discharge Summariescited by 2
- 2023Guidance in Radiology Report Summarization: An Empirical Evaluation and Error Analysiscited by 1
- 2024Intelligent Multi-Document Summarisation for Extracting Insights on Racial Inequalities from Maternity Incident Investigation Reportscited by 0
- 2026Toward Complete Hospital Discharge Summarization with Abstract Meaning Representationcited by 0
- 2026Toward Complete Hospital Discharge Summarization with Abstract Meaning Representation11 Sep 2026
- 2025Large Language Model-Based Generation of Discharge Summaries7 Dec 2025
- 2024CTISum: A New Benchmark Dataset For Cyber Threat Intelligence Summarization13 Aug 2024
- 2024Intelligent Multi-Document Summarisation for Extracting Insights on Racial Inequalities from Maternity Incident Investigation Reports11 Jul 2024
- 2024Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: A Benchmark Study29 Feb 2024
- 2023Context Aware Query Rewriting for Text Rankers using LLM31 Aug 2023
- 2023Guidance in Radiology Report Summarization: An Empirical Evaluation and Error Analysis24 Jul 2023
- 2023Query Understanding in the Age of Large Language Models28 Jun 2023