Progressive Transformer-Based Generation of Radiology Reports
Not on the map. Why?
Abstract (arXiv)
Inspired by Curriculum Learning, we propose a consecutive (i.e., image-to-text-to-text) generation framework where we divide the problem of radiology report generation into two steps. Contrary to generating the full radiology report from the image at once, the model generates global concepts from the image in the first step and then reforms them into finer and coherent texts using a transformer architecture. We follow the transformer-based sequence-to-sequence paradigm at each step. We improve upon the state-of-the-art on two benchmark datasets.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Builds on 25 of its 33 references that are in the map. First posted on arXiv 19 Feb 2021.
Builds on
25 of 33 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,310
- 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 966
- 2014Show and Tell: A Neural Image Caption Generatorcited by 877
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
13 more
- 2016Self-critical Sequence Training for Image Captioningcited by 544
- 2020Generating Radiology Reports via Memory-driven Transformercited by 363
- 2019Meshed-Memory Transformer for Image Captioningcited by 343
- 2016Image Captioning with Semantic Attentioncited by 260
- 2016Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioningcited by 231
- 2017On the Automatic Generation of Medical Imaging Reportscited by 215
- 2020When Radiology Report Generation Meets Knowledge Graphcited by 144
- 2018Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generationcited by 141
- 2019Clinically Accurate Chest X-Ray Report Generationcited by 138
- 2017NegBio: a high-performance tool for negation and uncertainty detection in radiology reportscited by 79
- 2016Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotationcited by 59
- 2020Show, Describe and Conclude: On Exploiting the Structure Information of Chest X-Ray Reportscited by 58
- 2020Progressive Generation of Long Text with Pretrained Language Modelscited by 14
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 14; 2024: 12; 2025: 9; 2026: 4.
43 papers.
Sort:
By area:
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 139
- 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generationcited by 114
- 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 93
- 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 92
- 2021Knowledge Matters: Radiology Report Generation with General and Specific Knowledgecited by 68
- 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
- 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoningcited by 39
- 2024HERGen: Elevating Radiology Report Generation with Longitudinal Datacited by 32
- 2024Libra: Leveraging Temporal Images for Biomedical Radiology Analysiscited by 29
- 2025RadVLM: A Multitask Conversational Vision-Language Model for Radiologycited by 24
- 2024AutoRG-Brain: Grounded Report Generation for Brain MRIcited by 23
31 more
- 2023RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoningcited by 22
- 2023Vision-Language Modelling For Radiological Imaging and Reports In The Low Data Regimecited by 15
- 2023Cross-Modal Causal Intervention for Medical Report Generationcited by 14
- 2023ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Datacited by 14
- 2023A Systematic Review of Deep Learning-based Research on Radiology Report Generationcited by 14
- 2024A Survey of Medical Vision-and-Language Applications and Their Techniquescited by 11
- 2025RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injectioncited by 11
- 2024CT-AGRG: Automated Abnormality-Guided Report Generation from 3D Chest CT Volumescited by 10
- 2024VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesiscited by 8
- 2022Self adaptive global-local feature enhancement for radiology report generationcited by 7
- 2025A Chain of Diagnosis Framework for Accurate and Explainable Radiology Report Generationcited by 6
- 2024MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancementcited by 4
- 2025Multimodal Large Language Models for Medical Report Generation via Customized Prompt Tuningcited by 4
- 2023Boosting Radiology Report Generation by Infusing Comparison Priorcited by 3
- 2023Radiology Report Generation Using Transformers Conditioned with Non-imaging Datacited by 3
- 2025MCA-RG: Enhancing LLMs with Medical Concept Alignment for Radiology Report Generationcited by 3
- 2024ICON: Improving Inter-Report Consistency in Radiology Report Generation via Lesion-aware Mixup Augmentationcited by 2
- 2024WoLF: Wide-scope Large Language Model Framework for CXR Understandingcited by 2
- 2025Automated Structured Radiology Report Generation with Rich Clinical Contextcited by 2
- 2025Vision-Language Models for Automated 3D PET/CT Report Generationcited by 2
- 2023Beyond Images: An Integrative Multi-modal Approach to Chest X-Ray Report Generationcited by 1
- 2024Knowledge-grounded Adaptation Strategy for Vision-language Models: Building Unique Case-set for Screening Mammograms for Residents Trainingcited by 1
- 2026NeuroSymb-MRG: Differentiable Abductive Reasoning with Active Uncertainty Minimization for Radiology Report Generationcited by 1
- 2026Graph-Augmented Topological Internalization with Dual-Stream Classifiers for Medical Report Generationcited by 1
- 2023Reading Radiology Imaging Like The Radiologistcited by 0
- 2023RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistancecited by 0
- 2024Intensive Vision-guided Network for Radiology Report Generationcited by 0
- 2025UniCrossAdapter: Multimodal Adaptation of CLIP for Radiology Report Generationcited by 0
- 2025EIR: Enhanced Image Representations for Medical Report Generationcited by 0
- 2026LLM-Bootstrapped Targeted Finding Guidance for Factual MLLM-based Medical Report Generationcited by 0
- 2026Rethinking the Efficiency and Effectiveness of Reinforcement Learning for Radiology Report Generationcited by 0
- 2026Graph-Augmented Topological Internalization with Dual-Stream Classifiers for Medical Report Generation4 May 2026
- 2026Rethinking the Efficiency and Effectiveness of Reinforcement Learning for Radiology Report Generation4 Mar 2026
- 2026NeuroSymb-MRG: Differentiable Abductive Reasoning with Active Uncertainty Minimization for Radiology Report Generation2 Mar 2026
- 2026LLM-Bootstrapped Targeted Finding Guidance for Factual MLLM-based Medical Report Generation28 Feb 2026
- 2025EIR: Enhanced Image Representations for Medical Report Generation29 Dec 2025
- 2025Vision-Language Models for Automated 3D PET/CT Report Generation25 Nov 2025
- 2025Automated Structured Radiology Report Generation with Rich Clinical Context1 Oct 2025
- 2025A Chain of Diagnosis Framework for Accurate and Explainable Radiology Report Generation13 Aug 2025
- 2025MCA-RG: Enhancing LLMs with Medical Concept Alignment for Radiology Report Generation9 Jul 2025
- 2025Multimodal Large Language Models for Medical Report Generation via Customized Prompt Tuning18 Jun 2025
- 2025RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injection20 May 2025
- 2025UniCrossAdapter: Multimodal Adaptation of CLIP for Radiology Report Generation20 Mar 2025
31 more
- 2025RadVLM: A Multitask Conversational Vision-Language Model for Radiology5 Feb 2025
- 2024Libra: Leveraging Temporal Images for Biomedical Radiology Analysis28 Nov 2024
- 2024MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancement27 Nov 2024
- 2024A Survey of Medical Vision-and-Language Applications and Their Techniques19 Nov 2024
- 2024CT-AGRG: Automated Abnormality-Guided Report Generation from 3D Chest CT Volumes21 Aug 2024
- 2024AutoRG-Brain: Grounded Report Generation for Brain MRI23 Jul 2024
- 2024HERGen: Elevating Radiology Report Generation with Longitudinal Data21 Jul 2024
- 2024Knowledge-grounded Adaptation Strategy for Vision-language Models: Building Unique Case-set for Screening Mammograms for Residents Training30 May 2024
- 2024Automated Radiology Report Generation: A Review of Recent Advances17 May 2024
- 2024VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis9 May 2024
- 2024WoLF: Wide-scope Large Language Model Framework for CXR Understanding19 Mar 2024
- 2024ICON: Improving Inter-Report Consistency in Radiology Report Generation via Lesion-aware Mixup Augmentation20 Feb 2024
- 2024Intensive Vision-guided Network for Radiology Report Generation6 Feb 2024
- 2023RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance30 Nov 2023
- 2023A Systematic Review of Deep Learning-based Research on Radiology Report Generation23 Nov 2023
- 2023Radiology Report Generation Using Transformers Conditioned with Non-imaging Data18 Nov 2023
- 2023Beyond Images: An Integrative Multi-modal Approach to Chest X-Ray Report Generation18 Nov 2023
- 2023RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoning21 Oct 2023
- 2023ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data8 Oct 2023
- 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generation24 Aug 2023
- 2023Reading Radiology Imaging Like The Radiologist12 Jul 2023
- 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning10 Jun 2023
- 2023Boosting Radiology Report Generation by Infusing Comparison Prior8 May 2023
- 2023Interactive and Explainable Region-guided Radiology Report Generation17 Apr 2023
- 2023Vision-Language Modelling For Radiological Imaging and Reports In The Low Data Regime30 Mar 2023
- 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generation18 Mar 2023
- 2023Cross-Modal Causal Intervention for Medical Report Generation16 Mar 2023
- 2022Self adaptive global-local feature enhancement for radiology report generation21 Nov 2022
- 2022Transformers in Medical Imaging: A Survey24 Jan 2022
- 2022Improving Chest X-Ray Report Generation by Leveraging Warm Starting24 Jan 2022
- 2021Knowledge Matters: Radiology Report Generation with General and Specific Knowledge30 Dec 2021
- 2025RadVLM: A Multitask Conversational Vision-Language Model for Radiologycited by 24
- 2023Vision-Language Modelling For Radiological Imaging and Reports In The Low Data Regimecited by 15
- 2025Multimodal Large Language Models for Medical Report Generation via Customized Prompt Tuningcited by 4
- 2024WoLF: Wide-scope Large Language Model Framework for CXR Understandingcited by 2
- 2024Knowledge-grounded Adaptation Strategy for Vision-language Models: Building Unique Case-set for Screening Mammograms for Residents Trainingcited by 1
- 2023RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistancecited by 0
- 2026LLM-Bootstrapped Targeted Finding Guidance for Factual MLLM-based Medical Report Generationcited by 0
- 2026LLM-Bootstrapped Targeted Finding Guidance for Factual MLLM-based Medical Report Generation28 Feb 2026
- 2025Multimodal Large Language Models for Medical Report Generation via Customized Prompt Tuning18 Jun 2025
- 2025RadVLM: A Multitask Conversational Vision-Language Model for Radiology5 Feb 2025
- 2024Knowledge-grounded Adaptation Strategy for Vision-language Models: Building Unique Case-set for Screening Mammograms for Residents Training30 May 2024
- 2024WoLF: Wide-scope Large Language Model Framework for CXR Understanding19 Mar 2024
- 2023RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance30 Nov 2023
- 2023Vision-Language Modelling For Radiological Imaging and Reports In The Low Data Regime30 Mar 2023
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 139
- 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generationcited by 114
- 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 93
- 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 92
- 2021Knowledge Matters: Radiology Report Generation with General and Specific Knowledgecited by 68
- 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
- 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoningcited by 39
- 2024HERGen: Elevating Radiology Report Generation with Longitudinal Datacited by 32
- 2024Libra: Leveraging Temporal Images for Biomedical Radiology Analysiscited by 29
- 2024AutoRG-Brain: Grounded Report Generation for Brain MRIcited by 23
- 2023RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoningcited by 22
12 most cited of 34 All 34 (JSON)
- 2026Graph-Augmented Topological Internalization with Dual-Stream Classifiers for Medical Report Generation4 May 2026
- 2026Rethinking the Efficiency and Effectiveness of Reinforcement Learning for Radiology Report Generation4 Mar 2026
- 2025EIR: Enhanced Image Representations for Medical Report Generation29 Dec 2025
- 2025Vision-Language Models for Automated 3D PET/CT Report Generation25 Nov 2025
- 2025Automated Structured Radiology Report Generation with Rich Clinical Context1 Oct 2025
- 2025A Chain of Diagnosis Framework for Accurate and Explainable Radiology Report Generation13 Aug 2025
- 2025MCA-RG: Enhancing LLMs with Medical Concept Alignment for Radiology Report Generation9 Jul 2025
- 2025RADAR: Enhancing Radiology Report Generation with Supplementary Knowledge Injection20 May 2025
- 2025UniCrossAdapter: Multimodal Adaptation of CLIP for Radiology Report Generation20 Mar 2025
- 2024Libra: Leveraging Temporal Images for Biomedical Radiology Analysis28 Nov 2024
- 2024MvKeTR: Chest CT Report Generation with Multi-View Perception and Knowledge Enhancement27 Nov 2024
- 2024A Survey of Medical Vision-and-Language Applications and Their Techniques19 Nov 2024
12 newest of 34 All 34 (JSON)