mlsanityData to 7 Oct 2026

UltraMedical: Building Specialized Generalists in Biomedicine

arXiv 2406.03949 ↗First posted 6 Jun 2024cs.CLcited by 67

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains and are moving towards more specialized areas. Recent advanced proprietary models such as GPT-4 and Gemini have achieved significant advancements in biomedicine, which have also raised privacy and security challenges. The construction of specialized generalists hinges largely on high-quality datasets, enhanced by techniques like supervised fine-tuning and reinforcement learning from human or AI feedback, and direct preference optimization. However, these leading technologies (e.g., preference learning) are still significantly limited in the open source community due to the scarcity of specialized data. In this paper, we present the UltraMedical collections, which consist of high-quality manual and synthetic datasets in the biomedicine domain, featuring preference annotations across multiple advanced LLMs. By utilizing these datasets, we fine-tune a suite of specialized medical models based on Llama-3 series, demonstrating breathtaking capabilities across various medical benchmarks. Moreover, we develop powerful reward models skilled in biomedical and general reward benchmark, enhancing further online preference learning within the biomedical LLM community. Datasets and models are available at https://github.com/TsinghuaC3I/UltraMedical

Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). Builds on 51 of its 73 references that are in the map. First posted on arXiv 6 Jun 2024.

Builds on

51 of 73 references.

References · 51

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  8. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  9. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  10. 2023Qwen Technical Reportcited by 3,273
  11. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  12. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
38 more
  1. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  2. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  3. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
  4. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  5. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  6. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
  7. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
  8. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
  9. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
  10. 2024Self-Rewarding Language Modelscited by 654
  11. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
  12. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  13. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
  14. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  15. 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 354
  16. 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
  17. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 299
  18. 2023Improving Text Embeddings with Large Language Modelscited by 295
  19. 2023A Long Way to Go: Investigating Length Correlations in RLHFcited by 285
  20. 2023MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Datacited by 282
  21. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
  22. 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
  23. 2023A Survey of Reinforcement Learning from Human Feedbackcited by 259
  24. 2024Reinforcement learningcited by 236
  25. 2024Capabilities of Gemini Models in Medicinecited by 231
  26. 2024Advancing LLM Reasoning Generalists with Preference Treescited by 191
  27. 2024Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Datacited by 184
  28. 2024Orca-Math: Unlocking the potential of SLMs in Grade School Mathcited by 151
  29. 2024Long-form factuality in large language modelscited by 146
  30. 2024Controllable Preference Optimization: Toward Controllable Multi-Objective Alignmentcited by 105
  31. 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
  32. 2023PMC-LLaMA: Towards Building Open-source Language Models for Medicinecited by 87
  33. 2024Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuningcited by 85
  34. 2024Med42 -- Evaluating Fine-Tuning Strategies for Medical LLMs: Full-Parameter vs. Parameter-Efficient Approachescited by 51
  35. 2024CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Followingcited by 32
  36. 2024Small Language Models Learn Enhanced Reasoning Skills from Medical Textbookscited by 30
  37. 2023Qilin-Med: Multi-stage Knowledge Injection Advanced Medical Large Language Modelcited by 24
  38. 2024D2PO: Discriminator-Guided DPO with Response Evaluation Modelscited by 9

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 13; 2025: 33; 2026: 21.

67 papers.

Sort:

By area:

  1. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 257
  2. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 212
  3. 2024Free Process Rewards without Process Labelscited by 162
  4. 2025m1: Unleash the Potential of Test-Time Scaling for Medical Reasoning with Large Language Modelscited by 42
  5. 2024A Survey on Data Synthesis and Augmentation for Large Language Modelscited by 40
  6. 2024Efficient Diffusion Models: A Comprehensive Survey from Principles to Practicescited by 39
  7. 2025The Avengers: A Simple Recipe for Uniting Smaller Language Models to Challenge Proprietary Giantscited by 37
  8. 2025Ultra-FineWeb: Efficient Data Filtering and Verification for High-Quality LLM Training Datacited by 35
  9. 2026LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routingcited by 35
  10. 2024Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluationcited by 33
  11. 2025MedHallu: A Comprehensive Benchmark for Detecting Medical Hallucinations in Large Language Modelscited by 33
  12. 2025Real-World Doctor Agent with Proactive Consultation through Multi-Agent Reinforcement Learningcited by 26
38 more
  1. 2024How to Synthesize Text Data without Model Collapse?cited by 24
  2. 2025MedS3: Towards Medical Slow Thinking with Self-Evolved Soft Dual-sided Process Supervisioncited by 23
  3. 2025MEDDxAgent: A Unified Modular Agent Framework for Explainable Automatic Differential Diagnosiscited by 23
  4. 2025Benchmarking Adversarial Robustness to Bias Elicitation in Large Language Models: Scalable Automated Assessment with LLM-as-a-Judgecited by 23
  5. 2025NeuroStrike: Neuron-Level Attacks on Aligned LLMscited by 18
  6. 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluationscited by 16
  7. 2024Automating Exploratory Proteomics Research via Language Modelscited by 11
  8. 2025BioHopR: A Benchmark for Multi-Hop, Multi-Answer Reasoning in Biomedical Domaincited by 10
  9. 2025The Dialogue That Heals: A Comprehensive Evaluation of Doctor Agents' Inquiry Capabilitycited by 10
  10. 2025Medical large language models are easily distractedcited by 9
  11. 2024Towards Building Specialized Generalist AI with System 1 and System 2 Fusioncited by 8
  12. 2025MedReflect: Teaching Medical LLMs to Self-Improve via Reflective Correctioncited by 8
  13. 2025ClinicalGPT-R1: Pushing reasoning capability of generalist disease diagnosis with large language modelcited by 7
  14. 2024Bailicai: A Domain-Optimized Retrieval-Augmented Generation Framework for Medical Applicationscited by 6
  15. 2025ShizhenGPT: Towards Multimodal LLMs for Traditional Chinese Medicinecited by 6
  16. 2025MediQAl: A French Medical Question Answering Dataset for Knowledge and Reasoning Evaluationcited by 5
  17. 2024Aqulia-Med LLM: Pioneering Full-Process Open-Source Medical Language Modelscited by 4
  18. 2025ExpertSteer: Intervening in LLMs through Expert Knowledgecited by 4
  19. 2024MedMobile: A mobile-sized language model with clinical capabilitiescited by 3
  20. 2025Improving Interactive Diagnostic Ability of a Large Language Model Agent Through Clinical Experience Learningcited by 3
  21. 2025Semi-Supervised Preference Optimization with Limited Feedbackcited by 3
  22. 2026From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAGcited by 3
  23. 2024CareBot: A Pioneering Full-Process Open-Source Medical Language Modelcited by 2
  24. 2025ModalTune: Fine-Tuning Slide-Level Foundation Models with Multi-Modal Information for Multi-task Learning in Digital Pathologycited by 2
  25. 2025Zero-Shot Multi-Disease Labeling of Chest, Abdomen, and Pelvis CT Reports Using Open-Weight Large Language Models: The Effect of Labeling Conventionscited by 2
  26. 2025Patient-Zero: Scaling Synthetic Patient Agents to Real-World Distributions without Real Patient Datacited by 2
  27. 2025A Survey of LLM Prompt Datasets: Taxonomy, Linguistic Patterns, and Practical Usescited by 2
  28. 2026Scaling Medical Reasoning Verification via Tool-Integrated Reinforcement Learningcited by 2
  29. 2026Finding and Reactivating Post-Trained LLMs' Hidden Safety Mechanismscited by 2
  30. 2026ProMedical: Hierarchical Fine-Grained Criteria Modeling for Medical LLM Alignment via Explicit Injectioncited by 2
  31. 2026MedPRMBench: A Fine-grained Benchmark for Process Reward Models in Medical Reasoningcited by 2
  32. 2026EHRBench: An Automated and Reliable EHR-based Benchmark for Clinical Decision Making with LLMscited by 2
  33. 2025RetSTA: An LLM-Based Approach for Standardizing Clinical Fundus Image Reportscited by 1
  34. 2025AnesSuite: A Comprehensive Benchmark and Dataset Suite for Anesthesiology Reasoning in LLMscited by 1
  35. 2025HBO: Hierarchical Balancing Optimization for Fine-Tuning Large Language Modelscited by 1
  36. 2025ClinBench-HPB: A Clinical Benchmark for Evaluating LLMs in Hepato-Pancreato-Biliary Diseasescited by 1
  37. 2025Automating Exploratory Multiomics Research via Language Modelscited by 1
  38. 2025HealthBranches: Synthesizing Clinically-Grounded Question Answering Datasets via Decision Pathwayscited by 1

50 most cited of 67 All 67 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024A Survey for Large Language Models in Biomedicine
  2. 2025Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL
  3. 2025IIMedGPT: Promoting Large Language Model Capabilities of Medical Tasks by Efficient Human Preference Alignment
  4. 2024Entry-level guide to the use of large language models for medical research
  5. 2023From Beginner to Expert: Modeling Medical Knowledge into General LLMs
  6. 2025Med-RewardBench: Benchmarking Reward Models and Judges for Medical Multimodal Large Language Models
  7. 2024Biomedical Large Languages Models Seem not to be Superior to Generalist Models on Unseen Medical Data
  8. 2026Why Specialist Models Still Matter: A Heterogeneous Multi-Agent Paradigm for Medical Artificial Intelligence