Boosting Radiology Report Generation by Infusing Comparison Prior
Not on the map. Why?
Abstract (arXiv)
Recent transformer-based models have made significant strides in generating radiology reports from chest X-ray images. However, a prominent challenge remains: these models often lack prior knowledge, resulting in the generation of synthetic reports that mistakenly reference non-existent prior exams. This discrepancy can be attributed to a knowledge gap between radiologists and the generation models. While radiologists possess patient-specific prior information, the models solely receive X-ray images at a specific time point. To tackle this issue, we propose a novel approach that leverages a rule-based labeler to extract comparison prior information from radiology reports. This extracted comparison prior is then seamlessly integrated into state-of-the-art transformer-based models, enabling them to produce more realistic and comprehensive reports. Our method is evaluated on English report datasets, such as IU X-ray and MIMIC-CXR. The results demonstrate that our approach surpasses baseline models in terms of natural language generation metrics. Notably, our model generates reports that are free from false references to non-existent prior exams, setting it apart from previous models. By addressing this limitation, our approach represents a significant step towards bridging the gap between radiologists and generation models in the domain of medical report generation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 8 May 2023.
Builds on
17 of 36 references.
References · 17
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
- 2020Generating Radiology Reports via Memory-driven Transformercited by 368
- 2019Meshed-Memory Transformer for Image Captioningcited by 343
- 2017On the Automatic Generation of Medical Imaging Reportscited by 216
- 2020Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generationcited by 141
- 2018TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-rayscited by 139
- 2019Clinically Accurate Chest X-Ray Report Generationcited by 139
5 more
- 2019Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generationcited by 102
- 2019Automatic Radiology Report Generation based on Multi-view Image Fusion and Medical Concept Enrichmentcited by 60
- 2017MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Networkcited by 56
- 2022Improving Radiology Report Generation Systems by Removing Hallucinated References to Non-existent Priorscited by 48
- 2021Progressive Transformer-Based Generation of Radiology Reportscited by 43
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.