SCL-RAI: Span-based Contrastive Learning with Retrieval Augmented Inference for Unlabeled Entity Problem in NER
On the map: Retrieval-augmented generation → Generation and context integration
Abstract (arXiv)
Named Entity Recognition is the task to locate and classify the entities in the text. However, Unlabeled Entity Problem in NER datasets seriously hinders the improvement of NER performance. This paper proposes SCL-RAI to cope with this problem. Firstly, we decrease the distance of span representations with the same label while increasing it for different ones via span-based contrastive learning, which relieves the ambiguity among entities and improves the robustness of the model over unlabeled entities. Then we propose retrieval augmented inference to mitigate the decision boundary shifting problem. Our method significantly outperforms the previous SOTA method by 4.21% and 8.64% F1-score on two real-world datasets.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 9 of its 18 references that are in the map. First posted on arXiv 4 Sep 2022.
Builds on
9 of 18 references.
References · 9
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Named Entity Recognition as Dependency Parsingcited by 150
- 2021Unified Named Entity Recognition as Word-Word Relation Classificationcited by 89
- 2017Automated Phrase Mining from Massive Text Corporacited by 70
- 2019Distantly Supervised Named Entity Recognition using Positive-Unlabeled Learningcited by 46
- 2020Empirical Analysis of Unlabeled Entity Problem in Named Entity Recognitioncited by 34
- 2017SwellShark: A Generative Model for Biomedical Named Entity Recognition without Labeled Datacited by 28
- 2021Rethinking Negative Sampling for Handling Missing Entity Annotationscited by 12
Built on by
Citing papers per year: 2023: 7; 2024: 1; 2025: 3.
11 papers.
- 2023MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learningcited by 171
- 2023SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agentscited by 71
- 2025A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Taskscited by 17
- 2023SANTA: Separate Strategies for Inaccurate and Incomplete Annotation Noise in Distantly-Supervised Named Entity Recognitioncited by 4
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Promptcited by 3
- 2025From Context to EDUs: Faithful and Structured Context Compression via Elementary Discourse Unit Decompositioncited by 3
- 2023Improving the Robustness of Distantly-Supervised Named Entity Recognition via Uncertainty-Aware Teacher Learning and Student-Student Collaborative Learningcited by 2
- 2023Self-Distillation with Meta Learning for Knowledge Graph Completioncited by 1
- 2023Data-Free Distillation of Language Model by Text-to-Text Transfercited by 1
- 2024Mitigating Language-Level Performance Disparity in mPLMs via Teacher Language Selection and Cross-lingual Self-Distillationcited by 1
- 2025Towards DS-NER: Unveiling and Addressing Latent Noise in Distant Annotationscited by 0
- 2025From Context to EDUs: Faithful and Structured Context Compression via Elementary Discourse Unit Decomposition16 Dec 2025
- 2025A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Tasks7 Oct 2025
- 2025Towards DS-NER: Unveiling and Addressing Latent Noise in Distant Annotations18 May 2025
- 2024Mitigating Language-Level Performance Disparity in mPLMs via Teacher Language Selection and Cross-lingual Self-Distillation12 Apr 2024
- 2023Improving the Robustness of Distantly-Supervised Named Entity Recognition via Uncertainty-Aware Teacher Learning and Student-Student Collaborative Learning14 Nov 2023
- 2023Data-Free Distillation of Language Model by Text-to-Text Transfer3 Nov 2023
- 2023UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt20 Sep 2023
- 2023MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning14 Sep 2023
- 2023SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agents22 May 2023
- 2023Self-Distillation with Meta Learning for Knowledge Graph Completion20 May 2023
- 2023SANTA: Separate Strategies for Inaccurate and Incomplete Annotation Noise in Distantly-Supervised Named Entity Recognition6 May 2023
Similar, not cited
Close in wording, no citation either way
- 2026NE-R1: Enhancing Named Entity Recognition Model via Reinforcement Learning
- 2026URA-NER: A Unified Retrieval-Augmented Framework with Retrieval Alignment and Uncertainty Reduction for Low-Resource NER
- 2022kNN-NER: Named Entity Recognition with Nearest Neighbor Search
- 2021Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training
- 2024Improving Few-Shot Cross-Domain Named Entity Recognition by Instruction Tuning a Word-Embedding based Retrieval Augmented Large Language Model
- 2024Learning Robust Named Entity Recognizers From Noisy Data With Retrieval Augmentation
- 2023DAMO-NLP at SemEval-2023 Task 2: A Unified Retrieval-augmented System for Multilingual Named Entity Recognition
- 2024Label Alignment and Reassignment with Generalist Large Language Model for Enhanced Cross-Domain Named Entity Recognition