mlsanityData to 14 Oct 2026

Boosting Radiology Report Generation by Infusing Comparison Prior

arXiv 2305.04561 ↗First posted 8 May 2023cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Recent transformer-based models have made significant strides in generating radiology reports from chest X-ray images. However, a prominent challenge remains: these models often lack prior knowledge, resulting in the generation of synthetic reports that mistakenly reference non-existent prior exams. This discrepancy can be attributed to a knowledge gap between radiologists and the generation models. While radiologists possess patient-specific prior information, the models solely receive X-ray images at a specific time point. To tackle this issue, we propose a novel approach that leverages a rule-based labeler to extract comparison prior information from radiology reports. This extracted comparison prior is then seamlessly integrated into state-of-the-art transformer-based models, enabling them to produce more realistic and comprehensive reports. Our method is evaluated on English report datasets, such as IU X-ray and MIMIC-CXR. The results demonstrate that our approach surpasses baseline models in terms of natural language generation metrics. Notably, our model generates reports that are free from false references to non-existent prior exams, setting it apart from previous models. By addressing this limitation, our approach represents a significant step towards bridging the gap between radiologists and generation models in the domain of medical report generation.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 8 May 2023.

Builds on

17 of 36 references.

References · 17

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2016Densely Connected Convolutional Networkscited by 6,720
  4. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  5. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  6. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
  7. 2020Generating Radiology Reports via Memory-driven Transformercited by 368
  8. 2019Meshed-Memory Transformer for Image Captioningcited by 343
  9. 2017On the Automatic Generation of Medical Imaging Reportscited by 216
  10. 2020Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generationcited by 141
  11. 2018TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-rayscited by 139
  12. 2019Clinically Accurate Chest X-Ray Report Generationcited by 139
5 more
  1. 2019Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generationcited by 102
  2. 2019Automatic Radiology Report Generation based on Multi-view Image Fusion and Medical Concept Enrichmentcited by 60
  3. 2017MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Networkcited by 56
  4. 2022Improving Radiology Report Generation Systems by Removing Hallucinated References to Non-existent Priorscited by 48
  5. 2021Progressive Transformer-Based Generation of Radiology Reportscited by 43

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.