Enhancing Scientific Named Entity Recognition via Large Language Models: A Type-driven Multi-task Learning Approach
Not on the map. Why?
Abstract (arXiv)
Scientific named entity recognition (SciNER) plays a crucial role in information extraction and knowledge discovery from scientific texts. Recently, large language models (LLMs) have demonstrated the capacity to achieve competitive SciNER performance with minimal human effort. Existing research highlights the importance of incorporating candidate entity type information for accurate entity recognition and classification by LLMs. However, when too many candidate entity types are provided in the prompt, LLMs struggle to accurately recognize and label entities in scientific texts, where entity types are more complex than in general domains. To address this challenge, we propose TdSciNER, a type-driven approach that effectively leverages entity type information to enhance SciNER performance. In TdSciNER, we first design an entity type filter model to identify the most likely entity types present in a given sentence. Subsequently, we introduce an auxiliary multi-class entity typing task within a multi-task learning framework alongside SciNER to obtain richer contextual representations. Then, we develop a novel demonstration selection strategy based on sentence similarity and entity type diversity to activate the in-context learning capabilities of LLMs, thereby improving entity recognition accuracy across diverse scientific domains. Experiments on three datasets demonstrate that our method achieves performance comparable to fully supervised models. Further analysis validates that each entity type-driven component in TdSciNER contributes to the improvement of SciNER performance. This work provides valuable insights for future advancements in SciNER and broader information extraction tasks in scientific text mining.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 80 references that are in the map. First posted on arXiv 9 Aug 2026.
Builds on
42 of 80 references.
References · 42
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 648
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 546
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
30 more
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 282
- 2023Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learningcited by 236
- 2022Unified Structure Generation for Universal Information Extractioncited by 221
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
- 2023GPT-NER: Named Entity Recognition via Large Language Modelscited by 160
- 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
- 2023Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineeringcited by 86
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 72
- 2021CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learningcited by 64
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2023Empirical Study of Zero-Shot NER with ChatGPTcited by 60
- 2019Identification of Tasks, Datasets, Evaluation Metrics, and Numeric Scores for Scientific Leaderboards Constructioncited by 50
- 2016Joint Extraction of Events and Entities within a Document Contextcited by 48
- 2023Model Tuning or Prompt Tuning? A Study of Large Language Models for Clinical Concept and Relation Extractioncited by 32
- 2022InstructionNER: A Multi-Task Instruction-Based Generative Framework for Few-shot NERcited by 31
- 2021TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metricscited by 30
- 2020DWIE: an entity-centric dataset for multi-task document-level information extractioncited by 29
- 2019Joint Learning of Named Entity Recognition and Entity Linkingcited by 26
- 2017Scientific Information Extraction with Semi-supervised Neural Taggingcited by 24
- 2021Learning from Language Description: Low-shot Named Entity Recognition via Decomposed Frameworkcited by 15
- 2024Few-shot clinical entity recognition in English, French and Spanish: masked language models outperform generative model promptingcited by 12
- 2022SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognitioncited by 8
- 2024ToNER: Type-oriented Named Entity Recognition with Generative Language Modelcited by 8
- 2021Can BERT Dig It? -- Named Entity Recognition for Information Retrieval in the Archaeology Domaincited by 5
- 2023Calibrated Seq2seq Models for Efficient and Generalizable Ultra-fine Entity Typingcited by 5
- 2024P-ICL: Point In-Context Learning for Named Entity Recognition with Large Language Modelscited by 5
- 2022A Review on Method Entities in the Academic Literature: Extraction, Evaluation, and Applicationcited by 4
- 2022Win-Win Cooperation: Bundling Sequence and Span Models for Named Entity Recognitioncited by 2
- 2023DMNER: Biomedical Entity Recognition by Detection and Matchingcited by 2
- 2026Revealing the Technology Development of Natural Language Processing: A Scientific Entity-Centric Perspectivecited by 2
Built on by
Not cited yet.