mlsanityData to 14 Oct 2026

Leveraging Summary Guidance on Medical Report Summarization

arXiv 2302.04001 ↗First posted 8 Feb 2023cs.CL cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

This study presents three deidentified large medical text datasets, named DISCHARGE, ECHO and RADIOLOGY, which contain 50K, 16K and 378K pairs of report and summary that are derived from MIMIC-III, respectively. We implement convincing baselines of automated abstractive summarization on the proposed datasets with pre-trained encoder-decoder language models, including BERT2BERT, T5-large and BART. Further, based on the BART model, we leverage the sampled summaries from the train set as prior knowledge guidance, for encoding additional contextual representations of the guidance with the encoder and enhancing the decoding representations in the decoder. The experimental results confirm the improvement of ROUGE scores and BERTScore made by the proposed method, outperforming the larger model T5-large.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 30 of its 61 references that are in the map. First posted on arXiv 8 Feb 2023.

Builds on

30 of 61 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  7. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  8. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  9. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
  10. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 670
  11. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
  12. 2019Text Summarization with Pretrained Encoderscited by 556
18 more
  1. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
  2. 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 244
  3. 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 222
  4. 2017On the Automatic Generation of Medical Imaging Reportscited by 216
  5. 2019Leveraging Pre-trained Checkpoints for Sequence Generation Taskscited by 182
  6. 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 162
  7. 2020GSum: A General Framework for Guided Neural Abstractive Summarizationcited by 129
  8. 2020Factual Error Correction for Abstractive Summarization Modelscited by 108
  9. 2019Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generationcited by 102
  10. 2019Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reportscited by 96
  11. 2021Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Trainingcited by 96
  12. 2018Learning to Summarize Radiology Findingscited by 54
  13. 2022FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarizationcited by 49
  14. 2018Natural Language Generation for Electronic Health Recordscited by 27
  15. 2022Towards Improving Faithfulness in Abstractive Summarizationcited by 27
  16. 2021Automated Generation of Accurate & Fluent Medical X-ray Reportscited by 24
  17. 2021Towards Clinical Encounter Summarization: Learning to Compose Discharge Summaries from Prior Notescited by 19
  18. 2022Salience Allocation as Guidance for Abstractive Summarizationcited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 3; 2025: 1; 2026: 1.

8 papers.