Few-Shot Nested Named Entity Recognition
Not on the map. Why?
Abstract (arXiv)
While Named Entity Recognition (NER) is a widely studied task, making inferences of entities with only a few labeled data has been challenging, especially for entities with nested structures. Unlike flat entities, entities and their nested entities are more likely to have similar semantic feature representations, drastically increasing difficulties in classifying different entity categories in the few-shot setting. Although prior work has briefly discussed nested structures in the context of few-shot learning, to our best knowledge, this paper is the first one specifically dedicated to studying the few-shot nested NER task. Leveraging contextual dependency to distinguish nested entities, we propose a Biaffine-based Contrastive Learning (BCL) framework. We first design a Biaffine span representation module for learning the contextual span dependency representation for each entity span rather than only learning its semantic representation. We then merge these two representations by the residual connection to distinguish nested entities. Finally, we build a contrastive learning framework to adjust the representation distribution for larger margin boundaries and more generalized domain transfer learning ability. We conducted experimental studies on three English, German, and Russian nested NER datasets. The results show that the BCL outperformed three baseline models on the 1-shot and 5-shot tasks in terms of F1 score.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 29 of its 47 references that are in the map. First posted on arXiv 2 Dec 2022.
Builds on
29 of 47 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 403
- 2020Understanding the Behaviour of Contrastive Losscited by 398
- 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
- 2021Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classificationcited by 183
- 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 152
- 2020Named Entity Recognition as Dependency Parsingcited by 151
17 more
- 2020Contrastive Learning with Adversarial Examplescited by 91
- 2021Unified Named Entity Recognition as Word-Word Relation Classificationcited by 90
- 2021Template-free Prompt Tuning for Few-shot NERcited by 73
- 2021CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learningcited by 64
- 2021Locate and Label: A Two-stage Identifier for Nested Named Entity Recognitioncited by 61
- 2021A Sequence-to-Set Network for Nested Named Entity Recognitioncited by 40
- 2019Nested Named Entity Recognition via Second-best Sequence Learning and Decodingcited by 34
- 2018Neural Segmental Hypergraphs for Overlapping Mention Recognitioncited by 32
- 2021An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labelingcited by 26
- 2020Nested Named Entity Recognition with Partially-Observed TreeCRFscited by 23
- 2022Decomposed Meta-Learning for Few-Shot Named Entity Recognitioncited by 22
- 2018Few-shot Learning for Named Entity Recognition in Medical Textcited by 19
- 2021Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognitioncited by 18
- 2021NEREL: A Russian Dataset with Nested Named Entities, Relations and Eventscited by 13
- 2022Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Taggingcited by 5
- 2021Few-Sample Named Entity Recognition for Security Vulnerability Reports by Fine-Tuning Pre-Trained Language Modelscited by 3
- 2019Learning to Control Latent Representations for Few-Shot Learning of Named Entitiescited by 1
Built on by
Citing papers per year: 2023: 2.
2 papers.