mlsanityData to 7 Oct 2026

Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B People

arXiv 2403.03640 ↗First posted 6 Mar 2024cs.CL cs.AIcited by 38

Not on the map. Why?

Abstract (arXiv)

Despite the vast repository of global medical knowledge predominantly being in English, local languages are crucial for delivering tailored healthcare services, particularly in areas with limited medical resources. To extend the reach of medical AI advancements to a broader population, we aim to develop medical LLMs across the six most widely spoken languages, encompassing a global population of 6.1 billion. This effort culminates in the creation of the ApolloCorpora multilingual medical dataset and the XMedBench benchmark. In the multilingual medical benchmark, the released Apollo models, at various relatively-small sizes (i.e., 0.5B, 1.8B, 2B, 6B, and 7B), achieve the best performance among models of equivalent size. Especially, Apollo-7B is the state-of-the-art multilingual medical LLMs up to 70B. Additionally, these lite models could be used to improve the multi-lingual medical capabilities of larger models without fine-tuning in a proxy-tuning fashion. We will open-source training corpora, code, model weights and evaluation benchmark.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 38 of its 63 references that are in the map. First posted on arXiv 6 Mar 2024.

Builds on

38 of 63 references.

References · 38

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  4. 2023Qwen Technical Reportcited by 3,273
  5. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  6. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
  7. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  8. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  9. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  10. 2022Galactica: A Large Language Model for Sciencecited by 736
  11. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  12. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
26 more
  1. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
  2. 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
  3. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
  4. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  5. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
  6. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 299
  7. 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 282
  8. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
  9. 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
  10. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 211
  11. 2022Can large language models reason about medical questions?cited by 194
  12. 2023A Study of Generative Large Language Model for Medical Research and Healthcarecited by 160
  13. 2023Self-Alignment with Instruction Backtranslationcited by 149
  14. 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 128
  15. 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 113
  16. 2019HEAD-QA: A Healthcare Dataset for Complex Reasoningcited by 100
  17. 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 91
  18. 2024Towards Building Multilingual Language Model for Medicinecited by 91
  19. 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 90
  20. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 89
  21. 2024Tuning Language Models by Proxycited by 88
  22. 2023Huatuo-26M, a Large-scale Chinese Medical QA Datasetcited by 46
  23. 2018Medical Exam Question Answering with Large-scale Reading Comprehensioncited by 29
  24. 2023FrenchMedMCQA: A French Multiple-Choice Question Answering Dataset for Medical domaincited by 25
  25. 2023Path to Medical AGI: Unify Domain-specific Medical LLMs with the Lowest Costcited by 12
  26. 2021Spanish Biomedical Crawled Corpus: A Large, Diverse Dataset for Spanish Biomedical Language Modelscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 13; 2025: 14; 2026: 11.

38 papers.

Sort:

By area:

  1. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 257
  2. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 217
  3. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 194
  4. 2024INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledgecited by 78
  5. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  6. 2024CoD, Towards an Interpretable Medical Agent using Chain of Diagnosiscited by 43
  7. 2024A Preliminary Study of o1 in Medicine: Are We Closer to an AI Doctor?cited by 33
  8. 2025The Rise of Small Language Models in Healthcare: A Comprehensive Surveycited by 18
  9. 2024Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Expertscited by 17
  10. 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluationscited by 16
  11. 2024Large Language Model Benchmarks in Medical Taskscited by 16
  12. 2025Citrus: Leveraging Expert Cognitive Pathways in a Medical Language Model for Advanced Medical Decision Supportcited by 16
26 more
  1. 2025Multimodal Large Language Models for Medicine: A Comprehensive Surveycited by 16
  2. 2025CLINIC: Evaluating Multilingual Trustworthiness in Language Models for Healthcarecited by 7
  3. 2024Domain-Specific Pretraining of Language Models: A Comparative Study in the Medical Fieldcited by 5
  4. 2025EHRStruct: A Comprehensive Benchmark Framework for Evaluating Large Language Models on Structured Electronic Health Record Taskscited by 5
  5. 2026MedAraBench: Large-Scale Arabic Medical Question Answering Dataset and Benchmarkcited by 3
  6. 2024Diabetica: Adapting Large Language Model to Enhance Multiple Medical Tasks in Diabetes Care and Managementcited by 2
  7. 2025InfiMed: Low-Resource Medical MLLMs with Advancing Understanding and Reasoningcited by 2
  8. 2026EHRBench: An Automated and Reliable EHR-based Benchmark for Clinical Decision Making with LLMscited by 2
  9. 2026ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understandingcited by 2
  10. 2025Reviewing Clinical Knowledge in Medical Large Language Models: Training and Beyondcited by 1
  11. 2024Performance Evaluation of Lightweight Open-source Large Language Models in Pediatric Consultations: A Comparative Analysiscited by 0
  12. 2024Towards Democratizing Multilingual Large Language Models For Medicine Through A Two-Stage Instruction Fine-tuning Approachcited by 0
  13. 2025CMQCIC-Bench: A Chinese Benchmark for Evaluating Large Language Models in Medical Quality Control Indicator Calculationcited by 0
  14. 2025Building Models of Neurological Languagecited by 0
  15. 2025ControlMed: Adding Reasoning Control to Medical Language Modelcited by 0
  16. 2025Think Globally, Group Locally: Evaluating LLMs Using Multi-Lingual Word Grouping Gamescited by 0
  17. 2025HEAD-QA v2: Expanding a Healthcare Benchmark for Reasoningcited by 0
  18. 2025Evaluating Small Language Models for Agentic On-Farm Decision Support Systemscited by 0
  19. 2026From Knowledge to Inference: Formalizing Specialized Public Health Reasoning on GlobalHealthAtlascited by 0
  20. 2026PACE-RAG: Patient-Aware Contextual and Evidence-Constrained RAG for Clinical Drug Recommendationcited by 0
  21. 2026Language corpora for the Dutch medical domaincited by 0
  22. 2026Do No Harm? Hallucination and Actor-Level Abuse in Web-Deployed Medical Large Language Modelscited by 0
  23. 2026HiMed: Incentivizing Hindi Reasoning in Medical LLMscited by 0
  24. 2026Bridging the English-Arabic Medical Knowledge Gap: Targeted Low-Rank Adaptation via Causal Layer Selectioncited by 0
  25. 2026HealMed: Multilingual Evaluation of Large Language Models in Medicinecited by 0
  26. 2026Perspectives on Cross-Lingual Consistency in LLMs for Medical Questionscited by 0