Best Practices for Large Language Models in Radiology
Not on the map. Why?
Abstract (arXiv)
At the heart of radiological practice is the challenge of integrating complex imaging data with clinical information to produce actionable insights. Nuanced application of language is key for various activities, including managing requests, describing and interpreting imaging findings in the context of clinical data, and concisely documenting and communicating the outcomes. The emergence of large language models (LLMs) offers an opportunity to improve the management and interpretation of the vast data in radiology. Despite being primarily general-purpose, these advanced computational models demonstrate impressive capabilities in specialized language-related tasks, even without specific training. Unlocking the potential of LLMs for radiology requires basic understanding of their foundations and a strategic approach to navigate their idiosyncrasies. This review, drawing from practical radiology and machine learning expertise and recent literature, provides readers insight into the potential of LLMs in radiology. It examines best practices that have so far stood the test of time in the rapidly evolving landscape of LLMs. This includes practical advice for optimizing LLM characteristics for radiology practices along with limitations, effective prompting, and fine-tuning strategies.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 67 of its 119 references that are in the map. First posted on arXiv 2 Dec 2024.
Builds on
67 of 119 references.
References · 67
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Visual Instruction Tuningcited by 7,792
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
38 more
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2023A Survey of Large Language Modelscited by 2,537
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2018Model Cards for Model Reportingcited by 1,068
- 2022A Generalist Agentcited by 802
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2021Carbon Emissions and Large Neural Network Trainingcited by 561
- 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 475
- 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
- 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 282
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
- 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
- 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
- 2024Capabilities of Gemini Models in Medicinecited by 231
- 2021VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioningcited by 190
- 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
- 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
- 2023Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMscited by 175
- 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 174
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicinecited by 5
- 2025Agentic Systems in Radiology: Design, Applications, Evaluation, and Challengescited by 5
- 2026MedRCube: A Multidimensional Framework for Fine-Grained and In-Depth Evaluation of MLLMs in Medical Imagingcited by 2
- 2026Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifactcited by 0
- 2026MARC v1: An Open-Source Multi-Agent Framework for Clinical AI Reasoning and Coordinationcited by 0
- 2026MARC v1: An Open-Source Multi-Agent Framework for Clinical AI Reasoning and Coordination13 Aug 2026
- 2026Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifact28 Jul 2026
- 2026MedRCube: A Multidimensional Framework for Fine-Grained and In-Depth Evaluation of MLLMs in Medical Imaging15 Apr 2026
- 2025Agentic Systems in Radiology: Design, Applications, Evaluation, and Challenges10 Oct 2025
- 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicine13 Feb 2025