mlsanityData to 14 Oct 2026

ReProCon: Scalable and Resource-Efficient Few-Shot Biomedical Named Entity Recognition

arXiv 2508.16833 ↗First posted 22 Aug 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Named Entity Recognition (NER) in biomedical domains faces challenges due to data scarcity and imbalanced label distributions, especially with fine-grained entity types. We propose ReProCon, a novel few-shot NER framework that combines multi-prototype modeling, cosine-contrastive learning, and Reptile meta-learning to tackle these issues. By representing each category with multiple prototypes, ReProCon captures semantic variability, such as synonyms and contextual differences, while a cosine-contrastive objective ensures strong interclass separation. Reptile meta-updates enable quick adaptation with little data. Using a lightweight fastText + BiLSTM encoder with much lower memory usage, ReProCon achieves a macro-F1 score close to BERT-based baselines (around 99 percent of BERT performance). The model remains stable with a label budget of 30 percent and only drops 7.8 percent in F1 when expanding from 19 to 50 categories, outperforming baselines such as SpanProto and CONTaiNER, which see 10 to 32 percent degradation in Few-NERD. Ablation studies highlight the importance of multi-prototype modeling and contrastive learning in managing class imbalance. Despite difficulties with label ambiguity, ReProCon demonstrates state-of-the-art performance in resource-limited settings, making it suitable for biomedical applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 22 Aug 2025.

Builds on

16 of 32 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2016Layer Normalizationcited by 5,669
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  6. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  7. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  9. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  10. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  11. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  12. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
4 more
  1. 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 152
  2. 2022Decomposed Meta-Learning for Few-Shot Named Entity Recognitioncited by 22
  3. 2022Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypescited by 17
  4. 2022SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognitioncited by 8

Built on by

Not cited yet.