MedBioLM: Optimizing Medical and Biological QA with Fine-Tuned Large Language Models and Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Medical and biomedical RAG
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated impressive capabilities across natural language processing tasks. However, their application to specialized domains such as medicine and biology requires further optimization to ensure factual accuracy, reliability, and contextual depth. We introduce MedBioLM, a domain-adapted biomedical question-answering model designed to enhance both short-form and long-form queries. By integrating fine-tuning and retrieval-augmented generation (RAG), MedBioLM dynamically incorporates domain-specific knowledge, improving reasoning abilities and factual accuracy. To evaluate its effectiveness, we fine-tuned the model on diverse biomedical QA datasets, covering structured multiple-choice assessments and complex clinical reasoning tasks. Fine-tuning significantly improves accuracy on benchmark datasets, while RAG enhances factual consistency. These results highlight the potential of domain-optimized LLMs in advancing biomedical research, medical education, and clinical decision support.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 10 of its 23 references that are in the map. First posted on arXiv 5 Feb 2025.
Builds on
10 of 23 references.
References · 10
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024GPT-4o System Cardcited by 4,467
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
- 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 272
- 2024Capabilities of Gemini Models in Medicinecited by 231
- 2023Towards Accurate Differential Diagnosis with Large Language Modelscited by 115
- 2024OLAPH: Improving Factuality in Biomedical Long-form Question Answeringcited by 20
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025PlainQAFact: Retrieval-augmented Factual Consistency Evaluation Metric for Biomedical Plain Language Summarizationcited by 4
- 2025CLIN-LLM: A Safety-Constrained Hybrid Framework for Clinical Diagnosis and Treatment Generationcited by 2
- 2025Perovskite-R1: a domain-specialized large language model for intelligent discovery of precursor additives and experimental designcited by 1
- 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoningcited by 1
- 2026How Does Prefix Matter in Reasoning Model Tuning?cited by 0
- 2026Aligning Clinical Needs and AI Capabilities: A Survey on LLMs for Medical Reasoning8 Jul 2026
- 2026How Does Prefix Matter in Reasoning Model Tuning?4 Jan 2026
- 2025CLIN-LLM: A Safety-Constrained Hybrid Framework for Clinical Diagnosis and Treatment Generation26 Oct 2025
- 2025Perovskite-R1: a domain-specialized large language model for intelligent discovery of precursor additives and experimental design22 Jul 2025
- 2025PlainQAFact: Retrieval-augmented Factual Consistency Evaluation Metric for Biomedical Plain Language Summarization11 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025MedBioRAG: Semantic Search and Retrieval-Augmented Generation with Large Language Models for Medical and Biological QA
- 2025Optimizing Medical Question-Answering Systems: A Comparative Study of Fine-Tuned and Zero-Shot Large Language Models with RAG Framework
- 2026Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale
- 2024LLM-MedQA: Enhancing Medical Question Answering through Case Studies in Large Language Models
- 2025Harnessing Collective Intelligence of LLMs for Robust Biomedical QA: A Multi-Model Approach
- 2025Structured Outputs Enable General-Purpose LLMs to be Medical Experts
- 2024A Survey for Large Language Models in Biomedicine
- 2026MedLLM: An Open Medical Language Model at the Sub-Billion Scale