mlsanityData to 7 Oct 2026

Best Practices for Large Language Models in Radiology

arXiv 2412.01233 ↗First posted 2 Dec 2024cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

At the heart of radiological practice is the challenge of integrating complex imaging data with clinical information to produce actionable insights. Nuanced application of language is key for various activities, including managing requests, describing and interpreting imaging findings in the context of clinical data, and concisely documenting and communicating the outcomes. The emergence of large language models (LLMs) offers an opportunity to improve the management and interpretation of the vast data in radiology. Despite being primarily general-purpose, these advanced computational models demonstrate impressive capabilities in specialized language-related tasks, even without specific training. Unlocking the potential of LLMs for radiology requires basic understanding of their foundations and a strategic approach to navigate their idiosyncrasies. This review, drawing from practical radiology and machine learning expertise and recent literature, provides readers insight into the potential of LLMs in radiology. It examines best practices that have so far stood the test of time in the rapidly evolving landscape of LLMs. This includes practical advice for optimizing LLM characteristics for radiology practices along with limitations, effective prompting, and fine-tuning strategies.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 67 of its 119 references that are in the map. First posted on arXiv 2 Dec 2024.

Builds on

67 of 119 references.

References · 67

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  9. 2020Scaling Laws for Neural Language Modelscited by 6,411
  10. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  11. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  12. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
38 more
  1. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  2. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  6. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  7. 2023A Survey of Large Language Modelscited by 2,537
  8. 2020Extracting Training Data from Large Language Modelscited by 2,144
  9. 2019Language Models as Knowledge Bases?cited by 1,922
  10. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  11. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
  12. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  13. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  14. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  15. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  16. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  17. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  18. 2018Model Cards for Model Reportingcited by 1,068
  19. 2022A Generalist Agentcited by 802
  20. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  21. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  22. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  23. 2021Carbon Emissions and Large Neural Network Trainingcited by 561
  24. 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 475
  25. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  26. 2023Explainability for Large Language Models: A Surveycited by 331
  27. 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
  28. 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 282
  29. 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 277
  30. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
  31. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  32. 2024Capabilities of Gemini Models in Medicinecited by 231
  33. 2021VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioningcited by 190
  34. 2023MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrievalcited by 182
  35. 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
  36. 2023Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMscited by 175
  37. 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 174
  38. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.