mlsanityData to 14 Oct 2026

Clinical Insights: A Comprehensive Review of Language Models in Medicine

arXiv 2408.11735 ↗First posted 21 Aug 2024cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

This paper explores the advancements and applications of language models in healthcare, focusing on their clinical use cases. It examines the evolution from early encoder-based systems requiring extensive fine-tuning to state-of-the-art large language and multimodal models capable of integrating text and visual data through in-context learning. The analysis emphasizes locally deployable models, which enhance data privacy and operational autonomy, and their applications in tasks such as text generation, classification, information extraction, and conversational systems. The paper also highlights a structured organization of tasks and a tiered ethical approach, providing a valuable resource for researchers and practitioners, while discussing key challenges related to ethics, evaluation, and implementation.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 131 of its 248 references that are in the map. First posted on arXiv 21 Aug 2024.

Builds on

131 of 248 references.

References · 131

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2024The Llama 3 Herd of Modelscited by 14,715
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  8. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  9. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  10. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  11. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  12. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
38 more
  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  6. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  7. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  10. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  11. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  12. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  13. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  14. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  15. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  16. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  17. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  18. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  19. 2019Language Models as Knowledge Bases?cited by 1,936
  20. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  21. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  22. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
  23. 2019Towards VQA Models That Can Readcited by 1,718
  24. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,593
  25. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  26. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  27. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  28. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
  29. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
  30. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  31. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  32. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  33. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
  34. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  35. 2018Model Cards for Model Reportingcited by 1,080
  36. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  37. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  38. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916

50 most cited of 131 All 131 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 4.

6 papers.

  1. 2025Memorization in Large Language Models in Medicine: Prevalence, Characteristics, and Implicationscited by 5
  2. 2025CLIN-LLM: A Safety-Constrained Hybrid Framework for Clinical Diagnosis and Treatment Generationcited by 3
  3. 2024Incorporating Metabolic Information into LLMs for Anomaly Detection in Clinical Time-Seriescited by 2
  4. 2024SleepCoT: A Lightweight Personalized Sleep Health Model via Chain-of-Thought Distillationcited by 1
  5. 2025Evaluating Structured Output Robustness of Small Language Models for Open Attribute-Value Extraction from Clinical Notescited by 1
  6. 2025Context-Emotion Aware Therapeutic Dialogue Generation: A Multi-component Reinforcement Learning Approach to Language Models for Mental Health Supportcited by 0