Radiology-Llama2: Best-in-Class Large Language Model for Radiology
Not on the map. Why?
Abstract (arXiv)
This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning. Radiology-Llama2 is based on the Llama2 architecture and further trained on a large dataset of radiology reports to generate coherent and clinically useful impressions from radiological findings. Quantitative evaluations using ROUGE metrics on the MIMIC-CXR and OpenI datasets demonstrate that Radiology-Llama2 achieves state-of-the-art performance compared to other generative language models, with a Rouge-1 score of 0.4834 on MIMIC-CXR and 0.4185 on OpenI. Additional assessments by radiology experts highlight the model's strengths in understandability, coherence, relevance, conciseness, and clinical utility. The work illustrates the potential of localized language models designed and tuned for specialized domains like radiology. When properly evaluated and deployed, such models can transform fields like radiology by automating rote tasks and enhancing human expertise.
Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). Builds on 39 of its 66 references that are in the map. First posted on arXiv 29 Aug 2023.
Builds on
39 of 66 references.
References · 39
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2023PaLM 2 Technical Reportcited by 1,162
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
27 more
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 368
- 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 162
- 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 131
- 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 130
- 2023Review of Large Vision Models and Visual Prompt Engineeringcited by 77
- 2022Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligencecited by 70
- 2023An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPTcited by 57
- 2023When Brain-inspired AI Meets AGIcited by 54
- 2023Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physicscited by 49
- 2023Radiology-GPT: A Large Language Model for Radiologycited by 44
- 2023BayLing: Bridging Cross-lingual Alignment and Instruction Following through Interactive Translation for Large Language Modelscited by 42
- 2023SAMAug: Point Prompt Augmentation for Segment Anything Modelcited by 38
- 2023AD-AutoGPT: An Autonomous GPT for Alzheimer's Disease Infodemiologycited by 34
- 2023Context Matters: A Strategy to Pre-train Language Model for Science Educationcited by 32
- 2023Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Taskcited by 32
- 2023Artificial General Intelligence for Medical Imaging Analysiscited by 32
- 2023ChatABL: Abductive Learning via Natural Language Interaction with ChatGPTcited by 26
- 2023Differentiate ChatGPT-generated and Human-written Medical Textscited by 26
- 2023Mask-guided BERT for Few Shot Text Classificationcited by 25
- 2023Segment Anything Model (SAM) for Radiation Oncologycited by 24
- 2023Exploring New Frontiers in Agricultural NLP: Investigating the Potential of Large Language Models for Food Applicationscited by 21
- 2022Coarse-to-fine Knowledge Graph Domain Adaptation based on Distantly-supervised Iterative Trainingcited by 20
- 2023CohortGPT: An Enhanced GPT for Participant Recruitment in Clinical Studycited by 19
- 2023Exploring Multimodal Approaches for Alzheimer's Disease Detection Using Patient Speech Transcript and Audio Datacited by 13
- 2023Evaluating Large Language Models for Radiology Natural Language Processingcited by 12
- 2023Deep-Learning-based Fast and Accurate 3D CT Deformable Image Registration in Lung Cancercited by 10
- 2022Discovering Dynamic Functional Brain Networks via Spatial and Channel-wise Attentioncited by 8
Built on by
Citing papers per year: 2023: 7; 2024: 21; 2025: 12; 2026: 2.
42 papers.
Sort:
By area:
- 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 246
- 2023Large language models in healthcare and medical domain: A reviewcited by 127
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 89
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
- 2023Qilin-Med-VL: Towards Chinese Large Vision-Language Model for General Healthcarecited by 62
- 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 59
- 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 27
- 2024Large Language Models for Manufacturingcited by 24
- 2023Large language models in medicine: the potentials and pitfallscited by 21
30 more
- 2023Holistic Evaluation of GPT-4V for Biomedical Imagingcited by 19
- 2024Benchmarking Pathology Foundation Models: Adaptation Strategies and Scenarioscited by 17
- 2024Trustworthy and Practical AI for Healthcare: A Guided Deferral System with Large Language Modelscited by 16
- 2025Multimodal Large Language Models for Medicine: A Comprehensive Surveycited by 16
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?cited by 15
- 2023ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Datacited by 14
- 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translationcited by 12
- 2024GP-GPT: Large Language Model for Gene-Phenotype Mappingcited by 11
- 2024The Mosaic Memory of Large Language Modelscited by 10
- 2024Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generationcited by 10
- 2024Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarioscited by 10
- 2024How Well Can Modern LLMs Act as Agent Cores in Radiology Environments?cited by 10
- 2025Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approachcited by 8
- 2025A Multimodal Multi-Agent Framework for Radiology Report Generationcited by 8
- 2024m3P: Towards Multimodal Multilingual Translation with Multimodal Promptcited by 6
- 2024RAD-PHI2: Instruction Tuning PHI-2 for Radiologycited by 4
- 2024RadPhi-3: Small Language Models for Radiologycited by 4
- 2025Large Language Models for Bioinformaticscited by 3
- 2024On Evaluation Protocols for Data Augmentation in a Limited Data Scenariocited by 2
- 2025Zero-Shot Multi-Disease Labeling of Chest, Abdomen, and Pelvis CT Reports Using Open-Weight Large Language Models: The Effect of Labeling Conventionscited by 2
- 2026Surg-R1: A Hierarchical Reasoning Foundation Model for Scalable and Interpretable Surgical Decision Support with Multi-Center Clinical Validationcited by 2
- 2024Integrating ChatGPT into Secure Hospital Networks: A Case Study on Improving Radiology Report Analysiscited by 1
- 2024The Role of Language Models in Modern Healthcare: A Comprehensive Reviewcited by 1
- 2025A Language Vision Model Approach for Automated Tumor Contouring in Radiation Oncologycited by 1
- 2025Leveraging Vision-Language Foundation Models to Reveal Hidden Image-Attribute Relationships in Medical Imagingcited by 1
- 2025Aligning Large Language Models with Healthcare Stakeholders: A Pathway to Trustworthy AI Integrationcited by 1
- 2026Comparative Analysis of Large Language Models in Healthcarecited by 1
- 2024MGH Radiology Llama: A Llama 3 70B Model for Radiologycited by 0
- 2025Balancing Knowledge Delivery and Emotional Comfort in Healthcare Conversational Systemscited by 0
- 2025Semantic Similarity in Radiology Reports via LLMs and NERcited by 0
- 2026Comparative Analysis of Large Language Models in Healthcare11 Apr 2026
- 2026Surg-R1: A Hierarchical Reasoning Foundation Model for Scalable and Interpretable Surgical Decision Support with Multi-Center Clinical Validation12 Mar 2026
- 2025Semantic Similarity in Radiology Reports via LLMs and NER3 Oct 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery18 Aug 2025
- 2025Balancing Knowledge Delivery and Emotional Comfort in Healthcare Conversational Systems16 Jun 2025
- 2025Zero-Shot Multi-Disease Labeling of Chest, Abdomen, and Pelvis CT Reports Using Open-Weight Large Language Models: The Effect of Labeling Conventions3 Jun 2025
- 2025A Multimodal Multi-Agent Framework for Radiology Report Generation14 May 2025
- 2025Aligning Large Language Models with Healthcare Stakeholders: A Pathway to Trustworthy AI Integration2 May 2025
- 2025Multimodal Large Language Models for Medicine: A Comprehensive Survey29 Apr 2025
- 2025Leveraging Vision-Language Foundation Models to Reveal Hidden Image-Attribute Relationships in Medical Imaging30 Mar 2025
- 2025A Language Vision Model Approach for Automated Tumor Contouring in Radiation Oncology19 Mar 2025
30 more
- 2025Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approach13 Mar 2025
- 2025Large Language Models for Bioinformatics10 Jan 2025
- 2024How Well Can Modern LLMs Act as Agent Cores in Radiology Environments?12 Dec 2024
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research30 Nov 2024
- 2024RadPhi-3: Small Language Models for Radiology19 Nov 2024
- 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translation18 Nov 2024
- 2024Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios16 Nov 2024
- 2024Large Language Models for Manufacturing28 Oct 2024
- 2024Benchmarking Pathology Foundation Models: Adaptation Strategies and Scenarios21 Oct 2024
- 2024The Role of Language Models in Modern Healthcare: A Comprehensive Review25 Sep 2024
- 2024GP-GPT: Large Language Model for Gene-Phenotype Mapping15 Sep 2024
- 2024MGH Radiology Llama: A Llama 3 70B Model for Radiology13 Aug 2024
- 2024Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generation12 Jun 2024
- 2024Trustworthy and Practical AI for Healthcare: A Guided Deferral System with Large Language Models11 Jun 2024
- 2024The Mosaic Memory of Large Language Models24 May 2024
- 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine14 May 2024
- 2024m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt26 Mar 2024
- 2024RAD-PHI2: Instruction Tuning PHI-2 for Radiology12 Mar 2024
- 2024On Evaluation Protocols for Data Augmentation in a Limited Data Scenario22 Feb 2024
- 2024Integrating ChatGPT into Secure Hospital Networks: A Case Study on Improving Radiology Report Analysis14 Feb 2024
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insights22 Jan 2024
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectives9 Jan 2024
- 2024Understanding LLMs: A Comprehensive Overview from Training to Inference4 Jan 2024
- 2023Large language models in healthcare and medical domain: A review12 Dec 2023
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?28 Nov 2023
- 2023Holistic Evaluation of GPT-4V for Biomedical Imaging10 Nov 2023
- 2023Qilin-Med-VL: Towards Chinese Large Vision-Language Model for General Healthcare27 Oct 2023
- 2023ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data8 Oct 2023
- 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarization14 Sep 2023
- 2023Large language models in medicine: the potentials and pitfalls31 Aug 2023
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2024Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarioscited by 10
- 2024How Well Can Modern LLMs Act as Agent Cores in Radiology Environments?cited by 10
- 2025A Multimodal Multi-Agent Framework for Radiology Report Generationcited by 8
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery18 Aug 2025
- 2025A Multimodal Multi-Agent Framework for Radiology Report Generation14 May 2025
- 2024How Well Can Modern LLMs Act as Agent Cores in Radiology Environments?12 Dec 2024
- 2024Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios16 Nov 2024
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 89
- 2023Qilin-Med-VL: Towards Chinese Large Vision-Language Model for General Healthcarecited by 62
- 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
- 2025Multimodal Large Language Models for Medicine: A Comprehensive Surveycited by 16
- 2025Leveraging Vision-Language Foundation Models to Reveal Hidden Image-Attribute Relationships in Medical Imagingcited by 1
- 2025Multimodal Large Language Models for Medicine: A Comprehensive Survey29 Apr 2025
- 2025Leveraging Vision-Language Foundation Models to Reveal Hidden Image-Attribute Relationships in Medical Imaging30 Mar 2025
- 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicine14 May 2024
- 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectives9 Jan 2024
- 2023Qilin-Med-VL: Towards Chinese Large Vision-Language Model for General Healthcare27 Oct 2023
- 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 246
- 2023Large language models in healthcare and medical domain: A reviewcited by 127
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
- 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 59
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 27
- 2024Large Language Models for Manufacturingcited by 24
- 2023Large language models in medicine: the potentials and pitfallscited by 21
- 2023Holistic Evaluation of GPT-4V for Biomedical Imagingcited by 19
- 2024Benchmarking Pathology Foundation Models: Adaptation Strategies and Scenarioscited by 17
- 2024Trustworthy and Practical AI for Healthcare: A Guided Deferral System with Large Language Modelscited by 16
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?cited by 15
- 2023ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Datacited by 14
12 most cited of 29 All 29 (JSON)
- 2026Comparative Analysis of Large Language Models in Healthcare11 Apr 2026
- 2025Semantic Similarity in Radiology Reports via LLMs and NER3 Oct 2025
- 2025Balancing Knowledge Delivery and Emotional Comfort in Healthcare Conversational Systems16 Jun 2025
- 2025Zero-Shot Multi-Disease Labeling of Chest, Abdomen, and Pelvis CT Reports Using Open-Weight Large Language Models: The Effect of Labeling Conventions3 Jun 2025
- 2025A Language Vision Model Approach for Automated Tumor Contouring in Radiation Oncology19 Mar 2025
- 2025Large Language Models for Bioinformatics10 Jan 2025
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research30 Nov 2024
- 2024RadPhi-3: Small Language Models for Radiology19 Nov 2024
- 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translation18 Nov 2024
- 2024Large Language Models for Manufacturing28 Oct 2024
- 2024Benchmarking Pathology Foundation Models: Adaptation Strategies and Scenarios21 Oct 2024
- 2024The Role of Language Models in Modern Healthcare: A Comprehensive Review25 Sep 2024
12 newest of 29 All 29 (JSON)