Summarizing Radiology Reports Findings into Impressions
Not on the map. Why?
Abstract (arXiv)
Patient hand-off and triage are two fundamental problems in health care. Often doctors must painstakingly summarize complex findings to efficiently communicate with specialists and quickly make decisions on which patients have the most urgent cases. In pursuit of these challenges, we present (1) a model with state-of-art radiology report summarization performance using (2) a novel method for augmenting medical data, and (3) an analysis of the model limitations and radiology knowledge gain. We also provide a data processing pipeline for future models developed on the the MIMIC CXR dataset. Our best performing model was a fine-tuned BERT-to-BERT encoder-decoder with 58.75/100 ROUGE-L F1, which outperformed specialized checkpoints with more sophisticated attention mechanisms. We investigate these aspects in this work.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 10 May 2024.
Builds on
14 of 26 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2019Publicly Available Clinical BERT Embeddingscited by 995
- 2020Efficient Transformers: A Surveycited by 784
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
- 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
- 2016Professor Forcing: A New Algorithm for Training Recurrent Networkscited by 214
- 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 67
2 more
Built on by
Citing papers per year: 2024: 1.
1 paper.