RadFusion: Towards Threshold-Controllable Radiology Report Generation
Not on the map. Why?
Abstract (arXiv)
Automated radiology report generation is advancing rapidly in response to the shortage of radiologists, yet unlike a perception model, existing generation models offer no control over the sensitivity-specificity trade-off of their diagnostic content. Such control is essential because clinical scenarios diverge: emergency triage prioritizes sensitivity to reduce missed findings, whereas confirmatory interpretation emphasizes specificity to limit unnecessary interventions. A single fixed report can neither adapt to these scenarios nor support the ROC-based validation widely expected for regulatory clearance. We introduce RadFusion, a framework that equips report generation with threshold controllability. Our method fuses a multi-label classifier, which provides per-disease confidence scores, with a VQA-based report generator, which describes medical findings in detail; an LLM then rewrites the report so that its stated diagnoses follow the classifier's decisions at the selected threshold while staying grounded in the generator's descriptions. On MIMIC-CXR, the performance of RadFusion conforms to the classifier's ROC curve: sweeping the threshold and mapping the reports back to class labels reproduces the classifier's validated ROC performance. This conformance makes generated reports quantitatively evaluable through ROC analysis, strengthening the case for regulatory clearance, and enables operating-point selection that matches report behavior to clinical context. Moreover, combining the two model types improves diagnostic accuracy over uncontrolled generation: sensitivity increases by 6.9% at matched specificity, and specificity by 20.7% at matched sensitivity. These results show that RadFusion makes report generation clinically adaptable, quantitatively verifiable, and diagnostically more reliable.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 11 Aug 2026.
Builds on
37 of 49 references.
References · 37
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2025OpenAI GPT-5 System Cardcited by 989
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
25 more
- 2025MedGemma Technical Reportcited by 436
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
- 2020Generating Radiology Reports via Memory-driven Transformercited by 368
- 2023Towards Generalist Biomedical AIcited by 289
- 2022Cross-modal Memory Networks for Radiology Report Generationcited by 185
- 2022DaViT: Dual Attention Vision Transformerscited by 175
- 2020When Radiology Report Generation Meets Knowledge Graphcited by 145
- 2024MAIRA-2: Grounded Radiology Report Generationcited by 145
- 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 140
- 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 95
- 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 95
- 2023MAIRA-1: A specialised large multimodal model for radiology report generationcited by 74
- 2025ConfTuner: Training Large Language Models to Express Their Confidence Verballycited by 39
- 2024MedVersa: A Generalist Foundation Model for Medical Image Interpretationcited by 38
- 2023When Does Optimizing a Proper Loss Yield Calibration?cited by 36
- 2024Libra: Leveraging Temporal Images for Biomedical Radiology Analysiscited by 29
- 2021VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labelscited by 27
- 2024Fact-Aware Multimodal Retrieval Augmentation for Accurate Medical Radiology Report Generationcited by 23
- 2023Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reportingcited by 18
- 2024QA-Calibration of Language Model Confidence Scorescited by 13
- 2024Scoring Rules and Calibration for Imprecise Probabilitiescited by 10
- 2021Trust It or Not: Confidence-Guided Automatic Radiology Report Generationcited by 9
- 2026Scaling medical imaging report generation with multimodal reinforcement learningcited by 9
- 2024DAug: Diffusion-based Channel Augmentation for Radiology Image Retrieval and Classificationcited by 1
Built on by
Not cited yet.