mlsanityData to 7 Oct 2026

MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Data

arXiv 2304.08247 ↗First posted 14 Apr 2023cs.CL cs.AIcited by 282

Not on the map. Why?

Cited by 21 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

As large language models (LLMs) like OpenAI's GPT series continue to make strides, we witness the emergence of artificial intelligence applications in an ever-expanding range of fields. In medicine, these LLMs hold considerable promise for improving medical workflows, diagnostics, patient care, and education. Yet, there is an urgent need for open-source models that can be deployed on-premises to safeguard patient privacy. In our work, we present an innovative dataset consisting of over 160,000 entries, specifically crafted to fine-tune LLMs for effective medical applications. We investigate the impact of fine-tuning these datasets on publicly accessible pre-trained LLMs, and subsequently, we juxtapose the performance of pre-trained-only models against the fine-tuned models concerning the examinations that future medical doctors must pass to achieve certification.

Key facts. Cited by 282 papers in the map (data through 7 Oct 2026). Builds on 8 of its 17 references that are in the map. First posted on arXiv 14 Apr 2023.

Builds on

8 of 17 references.

References · 8

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  6. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 881
  7. 2020Aligning AI With Shared Human Valuescited by 706
  8. 20218-bit Optimizers via Block-wise Quantizationcited by 395

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 50; 2024: 124; 2025: 76; 2026: 32.

282 papers.

Sort:

By area:

  1. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  2. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
  3. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 257
  4. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  5. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 228
  6. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 211
  7. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
  8. 2023Med-HALT: Medical Domain Hallucination Test for Large Language Modelscited by 156
  9. 2023Dolphins: Multimodal Language Model for Drivingcited by 124
  10. 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 124
  11. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  12. 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 121
38 more
  1. 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 121
  2. 2023Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Healthcited by 118
  3. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 118
  4. 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 106
  5. 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 103
  6. 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
  7. 2023Conversational Health Agents: A Personalized LLM-Powered Agent Frameworkcited by 91
  8. 2024Towards Building Multilingual Language Model for Medicinecited by 91
  9. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 89
  10. 2024Med42-v2: A Suite of Clinical LLMscited by 89
  11. 2023AlpaCare:Instruction-tuned Large Language Models for Medical Applicationcited by 88
  12. 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
  13. 2023PMC-LLaMA: Towards Building Open-source Language Models for Medicinecited by 87
  14. 2023Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videoscited by 84
  15. 2025MedRAG: Enhancing Retrieval-augmented Generation with Knowledge Graph-Elicited Reasoning for Healthcare Copilotcited by 83
  16. 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queriescited by 82
  17. 2023Towards Mitigating Hallucination in Large Language Models via Self-Reflectioncited by 81
  18. 2024Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directionscited by 77
  19. 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 74
  20. 2023Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encodingcited by 71
  21. 2023Is GPT-4 a Good Data Analyst?cited by 69
  22. 2024UltraMedical: Building Specialized Generalists in Biomedicinecited by 67
  23. 2024Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Datacited by 65
  24. 2024On the Societal Impact of Open Foundation Modelscited by 64
  25. 2023MentaLLaMA: Interpretable Mental Health Analysis on Social Media with Large Language Modelscited by 63
  26. 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Modelscited by 61
  27. 2023LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Modelscited by 58
  28. 2023DrugAssist: A Large Language Model for Molecule Optimizationcited by 57
  29. 2023MedAlign: A Clinician-Generated Dataset for Instruction Following with Electronic Medical Recordscited by 54
  30. 2024Instruction-tuned Language Models are Better Knowledge Learnerscited by 54
  31. 2023Publicly Shareable Clinical Large Language Model Built on Synthetic Clinical Notescited by 51
  32. 2024Med42 -- Evaluating Fine-Tuning Strategies for Medical LLMs: Full-Parameter vs. Parameter-Efficient Approachescited by 51
  33. 2023Adapting Large Language Models to Domains via Reading Comprehensioncited by 48
  34. 2023Large Language Models are Zero Shot Hypothesis Proposerscited by 45
  35. 2024RareBench: Can LLMs Serve as Rare Diseases Specialists?cited by 45
  36. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  37. 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferencescited by 43
  38. 2024MedSafetyBench: Evaluating and Improving the Medical Safety of Large Language Modelscited by 43

50 most cited of 282 All 282 (JSON)