mlsanityData to 14 Oct 2026

Pre-training, Reasoning, Benchmarking: X-ray Report Generation on CheXpert Plus Dataset

arXiv 2610.08813 ↗First posted 23 Sep 2026cs.CV cs.AIcited by 0

New in LLM reasoning; no direction yet. LLM reasoning

Abstract (arXiv)

X-ray image-based Radiology Report Generation (RRG) constitutes a critical research direction within medical artificial intelligence, with great potential to alleviate clinicians' diagnostic workload and shorten patient waiting periods. Despite substantial advances over recent years, the field faces evident bottlenecks stemming from insufficient standardized benchmarks and inadequate domain adaptation of generic large models. Notably, the newly released CheXpert Plus dataset is provided without accompanying baseline implementations and evaluation results, which impedes standardized training, quantitative evaluation and fair comparison among follow-up algorithms. To mitigate this limitation, we establish a comprehensive benchmark encompassing prevailing X-ray report generation models and Large Language Models on CheXpert Plus. This benchmark delivers a reliable comparative foundation for upcoming methods and enables researchers to rapidly identify state-of-the-art approaches within this domain. Beyond benchmark construction, we rethink X-ray RRG under the paradigm of large models and propose a novel framework termed MambaXray-PRB. Our framework improves report generation performance and enhances model interpretability via multi-stage large-model pre-training and multi-modal Chain-of-Thought reasoning. The pipeline consists of three successive phases: self-supervised auto-regressive modeling, X-ray-report contrastive learning, and post-training optimization for reasoning and report generation. Extensive experiments on IU X-ray, MIMIC-CXR, and CheXpert Plus datasets validate the effectiveness of MambaXray-PRB for radiology report generation. The source code of this paper is available on https://github.com/Event-AHU/Medical_Image_Analysis

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 88 of its 120 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

88 of 120 references.

References · 88

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2023GPT-4 Technical Reportcited by 18,396
  6. 2024The Llama 3 Herd of Modelscited by 14,715
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  9. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  10. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  11. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  12. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
38 more
  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  2. 2023Qwen Technical Reportcited by 3,344
  3. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  4. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  5. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  6. 2025Gemma 3 Technical Reportcited by 1,824
  7. 2020GLU Variants Improve Transformercited by 1,804
  8. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  9. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  10. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  11. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  12. 2024VMamba: Visual State Space Modelcited by 969
  13. 2024Yi: Open Foundation Models by 01.AIcited by 719
  14. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
  15. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
  16. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  17. 2024InternLM2 Technical Reportcited by 397
  18. 2020Generating Radiology Reports via Memory-driven Transformercited by 368
  19. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
  20. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 230
  21. 2026MiMo-V2-Flash Technical Reportcited by 191
  22. 2026Qwen3.5-Omni Technical Reportcited by 174
  23. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
  24. 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 162
  25. 2023Orca 2: Teaching Small Language Models How to Reasoncited by 159
  26. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 128
  27. 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generationcited by 118
  28. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Modelscited by 116
  29. 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 114
  30. 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 106
  31. 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 102
  32. 2023METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokenscited by 101
  33. 2024Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMscited by 96
  34. 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 95
  35. 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 95
  36. 2026Mamba-3: Improved Sequence Modeling using State Space Principlescited by 89
  37. 2023CXR-CLIP: Toward Large Scale Chest X-ray Language-Image Pre-trainingcited by 82
  38. 2022Competence-based Multimodal Curriculum Learning for Medical Report Generationcited by 76

50 most cited of 88 All 88 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Review of Longitudinal Radiology Report Generation: Dataset Composition, Methods, and Performance Evaluation
  2. 2026Radiology Report Generation for Low-Quality X-Ray Images
  3. 2025EMRRG: Efficient Fine-Tuning Pre-trained X-ray Mamba Networks for Radiology Report Generation
  4. 2024A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretation
  5. 2024CheXalign: Preference fine-tuning in chest X-ray interpretation models without human feedback
  6. 2024TiBiX: Leveraging Temporal Information for Bidirectional X-ray and Report Generation
  7. 2023Consensus, dissensus and synergy between clinicians and specialist foundation models in radiology report generation
  8. 2026CXRMate-2: Structured Multimodal Temporal Embeddings and Tractable Reinforcement Learning for Clinically Acceptable Chest X-ray Radiology Report Generation