Harnessing Large Language Models for Biomedical Named Entity Recognition
Not on the map. Why?
Abstract (arXiv)
Background and Objective: Biomedical Named Entity Recognition (BioNER) is a foundational task in medical informatics, crucial for downstream applications like drug discovery and clinical trial matching. However, adapting general-domain Large Language Models (LLMs) to this task is often hampered by their lack of domain-specific knowledge and the performance degradation caused by low-quality training data. To address these challenges, we introduce BioSelectTune, a highly efficient, data-centric framework for fine-tuning LLMs that prioritizes data quality over quantity. Methods and Results: BioSelectTune reformulates BioNER as a structured JSON generation task and leverages our novel Hybrid Superfiltering strategy, a weak-to-strong data curation method that uses a homologous weak model to distill a compact, high-impact training dataset. Conclusions: Through extensive experiments, we demonstrate that BioSelectTune achieves state-of-the-art (SOTA) performance across multiple BioNER benchmarks. Notably, our model, trained on only 50% of the curated positive data, not only surpasses the fully-trained baseline but also outperforms powerful domain-specialized models like BioMedBERT.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 31 references that are in the map. First posted on arXiv 28 Dec 2025.
Builds on
16 of 31 references.
References · 16
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
- 2023GPT-NER: Named Entity Recognition via Large Language Modelscited by 158
- 2024Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuningcited by 134
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
- 2023How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Taskscited by 58
4 more
- 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
- 2024LLMs in Biomedicine: A study on clinical Named Entity Recognitioncited by 12
- 2024llmNER: (Zero|Few)-Shot Named Entity Recognition, Exploiting the Power of Large Language Modelscited by 4
- 2023Demonstration-based learning for few-shot biomedical named entity recognition under machine reading comprehensioncited by 1
Built on by
Not cited yet.