CXRMate-2: Structured Multimodal Temporal Embeddings and Tractable Reinforcement Learning for Clinically Acceptable Chest X-ray Radiology Report Generation
Not on the map. Why?
Abstract (arXiv)
Chest X-ray (CXR) radiology report generation (RRG) models have shown rapid progress on automated metrics, yet their clinical utility remains uncertain due to limited qualitative evaluation by radiologists. We present CXRMate-2, a state-of-the-art CXR RRG model that enables tractable reinforcement learning (RL) through structured multimodal temporal embeddings and high-resolution visual feature compression, for efficient, unified conditioning of an LLM decoder on visual, textual, and temporal context from a study and its prior. This enables group relative policy optimisation (GRPO), where a proposed reward function is used to improve semantic alignment with radiologist reports. Across the MIMIC-CXR, CheXpert Plus, and ReXgradient datasets, CXRMate-2 achieves statistically significant improvements over strong benchmarks, including gains of 11.2% and 24.4% in GREEN and RadGraph-XL, respectively, on MIMIC-CXR relative to MedGemma 1.5 (4B). To directly compare CXRMate-2 against radiologist reporting, we conduct a blinded, randomised qualitative retrospective evaluation. Three consultant radiologists compare generated and radiologist reports across 120 studies from the MIMIC-CXR test set. Generated reports were deemed acceptable (defined as preferred or rated equally to radiologist reports) in 45% of ratings, with no statistically significant difference in preference rates for seven of the eight analysed findings. Preferences for radiologist reports were driven primarily by higher recall, while generated reports were consistently preferred for readability. Together, these results define a clear pathway to clinically acceptable CXR RRG. Improving recall and the detection of subtle findings represents the primary remaining barrier to non-inferiority with radiologist reporting, positioning CXR RRG for prospective evaluation in assistive, radiologist-led workflows.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 63 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
29 of 63 references.
References · 29
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2016Self-critical Sequence Training for Image Captioningcited by 547
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
- 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 337
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
- 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 211
- 2020Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generationcited by 141
- 2019Clinically Accurate Chest X-Ray Report Generationcited by 139
17 more
- 2024Exploring scalable medical image encoders beyond text supervisioncited by 132
- 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 128
- 2022The Devil in Linear Transformercited by 98
- 2022Improving the Factual Correctness of Radiology Report Generation with Semantic Rewardscited by 83
- 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
- 2025Enhanced Contrastive Learning with Multi-view Longitudinal Data for Chest X-ray Report Generationcited by 42
- 2024Libra: Leveraging Temporal Images for Biomedical Radiology Analysiscited by 29
- 2023RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generationcited by 25
- 2023Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generationcited by 24
- 2025RadEval: A framework for radiology text evaluationcited by 22
- 2025Automated Structured Radiology Report Generationcited by 15
- 2022DeltaNet:Conditional Medical Report Generation for COVID-19 Diagnosiscited by 13
- 2023Pragmatic Radiology Report Generationcited by 12
- 2024e-Health CSIRO at RRG24: Entropy-Augmented Self-Critical Sequence Training for Radiology Report Generationcited by 10
- 2025PriorRG: Prior-Guided Contrastive Pre-training and Coarse-to-Fine Decoding for Chest X-ray Report Generationcited by 9
- 2024The Impact of Auxiliary Patient Data on Automated Chest X-Ray Report Generation and How to Incorporate Itcited by 8
- 2025Toward Clinically Explainable AI for Medical Diagnosis: A Foundation Model with Human-Compatible Reasoning via Reinforcement Learningcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Advancing Text-Driven Chest X-Ray Generation with Policy-Based Reinforcement Learning
- 2025Enhancing Radiology Report Generation and Visual Grounding using Reinforcement Learning
- 2024CheXalign: Preference fine-tuning in chest X-ray interpretation models without human feedback
- 2026Scaling medical imaging report generation with multimodal reinforcement learning
- 2026REVA-PO: Stabilizing Reinforcement Learning for Chest X-ray Report Generation
- 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learning
- 2026CARE-X: Towards Clinically Useful Radiology VLMs with Auxiliary Supervision, Reward-Aligned Learning, and Tool-Augmented Measurement
- 2026DobicVLM: Aligning Chest X-Ray Report Generation with Clinically-Grounded Programmatic Rewards via Group Relative Policy Optimization