A Unified Label-Aware Contrastive Learning Framework for Few-Shot Named Entity Recognition
Not on the map. Why?
Abstract (arXiv)
Few-shot Named Entity Recognition (NER) aims to extract named entities using only a limited number of labeled examples. Existing contrastive learning methods often suffer from insufficient distinguishability in context vector representation because they either solely rely on label semantics or completely disregard them. To tackle this issue, we propose a unified label-aware token-level contrastive learning framework. Our approach enriches the context by utilizing label semantics as suffix prompts. Additionally, it simultaneously optimizes context-context and context-label contrastive learning objectives to enhance generalized discriminative contextual representations.Extensive experiments on various traditional test domains (OntoNotes, CoNLL'03, WNUT'17, GUM, I2B2) and the large-scale few-shot NER dataset (FEWNERD) demonstrate the effectiveness of our approach. It outperforms prior state-of-the-art models by a significant margin, achieving an average absolute gain of 7% in micro F1 scores across most scenarios. Further analysis reveals that our model benefits from its powerful transfer capability and improved contextual representations.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 26 Apr 2024.
Builds on
21 of 27 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2018Meta-Learning: A Surveycited by 254
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2019SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learningcited by 194
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021Template-Based Named Entity Recognition Using BARTcited by 153
- 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 150
- 2018Meta-Learning for Low-Resource Neural Machine Translationcited by 105
9 more
- 2020Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Networkcited by 83
- 2021Template-free Prompt Tuning for Few-shot NERcited by 73
- 2019Induction Networks for Few-Shot Text Classificationcited by 64
- 2021CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learningcited by 64
- 2019Few-shot Text Classification with Distributional Signaturescited by 58
- 2020Few-Shot Named Entity Recognition: A Comprehensive Studycited by 41
- 2021Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NERcited by 38
- 2022Decomposed Meta-Learning for Few-Shot Named Entity Recognitioncited by 22
- 2022Label Semantics for Few Shot Named Entity Recognitioncited by 21
Built on by
Not cited yet.