mlsanityData to 7 Oct 2026

Harnessing Large Language Models for Biomedical Named Entity Recognition

arXiv 2512.22738 ↗First posted 28 Dec 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Background and Objective: Biomedical Named Entity Recognition (BioNER) is a foundational task in medical informatics, crucial for downstream applications like drug discovery and clinical trial matching. However, adapting general-domain Large Language Models (LLMs) to this task is often hampered by their lack of domain-specific knowledge and the performance degradation caused by low-quality training data. To address these challenges, we introduce BioSelectTune, a highly efficient, data-centric framework for fine-tuning LLMs that prioritizes data quality over quantity. Methods and Results: BioSelectTune reformulates BioNER as a structured JSON generation task and leverages our novel Hybrid Superfiltering strategy, a weak-to-strong data curation method that uses a homologous weak model to distill a compact, high-impact training dataset. Conclusions: Through extensive experiments, we demonstrate that BioSelectTune achieves state-of-the-art (SOTA) performance across multiple BioNER benchmarks. Notably, our model, trained on only 50% of the curated positive data, not only surpasses the fully-trained baseline but also outperforms powerful domain-specialized models like BioMedBERT.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 31 references that are in the map. First posted on arXiv 28 Dec 2025.

Builds on

16 of 31 references.

References · 16

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  5. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  6. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
  7. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
  8. 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
  9. 2023GPT-NER: Named Entity Recognition via Large Language Modelscited by 158
  10. 2024Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuningcited by 134
  11. 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
  12. 2023How Robust is GPT-3.5 to Predecessors? A Comprehensive Study on Language Understanding Taskscited by 58
4 more
  1. 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
  2. 2024LLMs in Biomedicine: A study on clinical Named Entity Recognitioncited by 12
  3. 2024llmNER: (Zero|Few)-Shot Named Entity Recognition, Exploiting the Power of Large Language Modelscited by 4
  4. 2023Demonstration-based learning for few-shot biomedical named entity recognition under machine reading comprehensioncited by 1

Built on by

Not cited yet.