Pre-training, Reasoning, Benchmarking: X-ray Report Generation on CheXpert Plus Dataset
New in LLM reasoning; no direction yet. LLM reasoning
Abstract (arXiv)
X-ray image-based Radiology Report Generation (RRG) constitutes a critical research direction within medical artificial intelligence, with great potential to alleviate clinicians' diagnostic workload and shorten patient waiting periods. Despite substantial advances over recent years, the field faces evident bottlenecks stemming from insufficient standardized benchmarks and inadequate domain adaptation of generic large models. Notably, the newly released CheXpert Plus dataset is provided without accompanying baseline implementations and evaluation results, which impedes standardized training, quantitative evaluation and fair comparison among follow-up algorithms. To mitigate this limitation, we establish a comprehensive benchmark encompassing prevailing X-ray report generation models and Large Language Models on CheXpert Plus. This benchmark delivers a reliable comparative foundation for upcoming methods and enables researchers to rapidly identify state-of-the-art approaches within this domain. Beyond benchmark construction, we rethink X-ray RRG under the paradigm of large models and propose a novel framework termed MambaXray-PRB. Our framework improves report generation performance and enhances model interpretability via multi-stage large-model pre-training and multi-modal Chain-of-Thought reasoning. The pipeline consists of three successive phases: self-supervised auto-regressive modeling, X-ray-report contrastive learning, and post-training optimization for reasoning and report generation. Extensive experiments on IU X-ray, MIMIC-CXR, and CheXpert Plus datasets validate the effectiveness of MambaXray-PRB for radiology report generation. The source code of this paper is available on https://github.com/Event-AHU/Medical_Image_Analysis
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 88 of its 120 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
88 of 120 references.
References · 88
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
38 more
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2023Qwen Technical Reportcited by 3,344
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2025Gemma 3 Technical Reportcited by 1,824
- 2020GLU Variants Improve Transformercited by 1,804
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2024VMamba: Visual State Space Modelcited by 969
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2024InternLM2 Technical Reportcited by 397
- 2020Generating Radiology Reports via Memory-driven Transformercited by 368
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 230
- 2026MiMo-V2-Flash Technical Reportcited by 191
- 2026Qwen3.5-Omni Technical Reportcited by 174
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
- 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 162
- 2023Orca 2: Teaching Small Language Models How to Reasoncited by 159
- 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 128
- 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generationcited by 118
- 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 116
- 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 114
- 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 106
- 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 102
- 2023METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokenscited by 101
- 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 96
- 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 95
- 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 95
- 2026Mamba-3: Improved Sequence Modeling using State Space Principlescited by 89
- 2023CXR-CLIP: Toward Large Scale Chest X-ray Language-Image Pre-trainingcited by 82
- 2022Competence-based Multimodal Curriculum Learning for Medical Report Generationcited by 76
50 most cited of 88 All 88 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025A Review of Longitudinal Radiology Report Generation: Dataset Composition, Methods, and Performance Evaluation
- 2026Radiology Report Generation for Low-Quality X-Ray Images
- 2025EMRRG: Efficient Fine-Tuning Pre-trained X-ray Mamba Networks for Radiology Report Generation
- 2024A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretation
- 2024CheXalign: Preference fine-tuning in chest X-ray interpretation models without human feedback
- 2024TiBiX: Leveraging Temporal Information for Bidirectional X-ray and Report Generation
- 2023Consensus, dissensus and synergy between clinicians and specialist foundation models in radiology report generation
- 2026CXRMate-2: Structured Multimodal Temporal Embeddings and Tractable Reinforcement Learning for Clinically Acceptable Chest X-ray Radiology Report Generation