mlsanityData to 7 Oct 2026

e-Health CSIRO at RRG24: Entropy-Augmented Self-Critical Sequence Training for Radiology Report Generation

arXiv 2408.03500 ↗First posted 7 Aug 2024cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

The Shared Task on Large-Scale Radiology Report Generation (RRG24) aims to expedite the development of assistive systems for interpreting and reporting on chest X-ray (CXR) images. This task challenges participants to develop models that generate the findings and impression sections of radiology reports from CXRs from a patient's study, using five different datasets. This paper outlines the e-Health CSIRO team's approach, which achieved multiple first-place finishes in RRG24. The core novelty of our approach lies in the addition of entropy regularisation to self-critical sequence training, to maintain a higher entropy in the token distribution. This prevents overfitting to common phrases and ensures a broader exploration of the vocabulary during training, essential for handling the diversity of the radiology reports in the RRG24 datasets. Our model is available on Hugging Face https://huggingface.co/aehrc/cxrmate-rrg24.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 7 Aug 2024.

Builds on

10 of 21 references.

References · 10

  1. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  2. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
  3. 2016Self-critical Sequence Training for Image Captioningcited by 544
  4. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
  5. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
  6. 2022UniFormer: Unifying Convolution and Self-attention for Visual Recognitioncited by 206
  7. 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 93
  8. 2020BIMCV COVID-19+: a large annotated dataset of RX and CT images from COVID-19 patientscited by 81
  9. 2023Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generationcited by 24
  10. 2024The Impact of Auxiliary Patient Data on Automated Chest X-Ray Report Generation and How to Incorporate Itcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 3.

10 papers.

  1. 2024CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Datasetcited by 33
  2. 2024Overview of the First Shared Task on Clinical Text Generation: RRG24 and "Discharge Me!"cited by 19
  3. 2024LaB-RAG: Label Boosted Retrieval Augmented Generation for Radiology Report Generationcited by 2
  4. 2025OraPO: Oracle-educated Reinforcement Learning for Data-efficient and Factual Radiology Report Generationcited by 1
  5. 2025Random Direct Preference Optimization for Radiography Report Generationcited by 1
  6. 2025Generalised Medical Phrase Groundingcited by 1
  7. 2026CURE: Curriculum-guided Multi-task Training for Reliable Anatomy Grounded Report Generationcited by 1
  8. 2025Privacy-Preserving Chest X-ray Report Generation via Multimodal Federated Learning with ViT and GPT-2cited by 0
  9. 2026CXRMate-2: Structured Multimodal Temporal Embeddings and Tractable Reinforcement Learning for Clinically Acceptable Chest X-ray Radiology Report Generationcited by 0
  10. 2026SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generationcited by 0