kNN-NER: Named Entity Recognition with Nearest Neighbor Search
On the map: Retrieval-augmented generation → Generation and context integration
Abstract (arXiv)
Inspired by recent advances in retrieval augmented methods in NLP~citepkhandelwal2019generalization,khandelwal2020nearest,meng2021gnn, in this paper, we introduce a k nearest neighbor NER (kNN-NER) framework, which augments the distribution of entity labels by assigning k nearest neighbors retrieved from the training set. This strategy makes the model more capable of handling long-tail cases, along with better few-shot learning abilities. kNN-NER requires no additional operation during the training phase, and by interpolating k nearest neighbors search into the vanilla NER model, kNN-NER consistently outperforms its vanilla counterparts: we achieve a new state-of-the-art F1-score of 72.03 (+1.25) on the Chinese Weibo dataset and improved results on a variety of widely used NER benchmarks. Additionally, we show that kNN-NER can achieve comparable results to the vanilla NER model with 40% less amount of training data. Code available at urlhttps://github.com/ShannonAI/KNN-NER.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 26 of its 46 references that are in the map. First posted on arXiv 31 Mar 2022.
Builds on
26 of 46 references.
Closest ancestors · 2
Same direction, newest first
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks22 May
- 2020REALM: Retrieval-Augmented Language Model Pre-Training10 Feb
Other references · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
- 2019Generalization through Memorization: Nearest Neighbor Language Modelscited by 788
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2020Nearest Neighbor Machine Translationcited by 209
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
- 2019Dice Loss for Data-imbalanced NLP Taskscited by 180
- 2020Pre-training via Paraphrasingcited by 92
- 2018Retrieve and Refine: Improved Sequence Generation Models For Dialoguecited by 82
12 more
- 2021BertGCN: Transductive Text Classification by Combining GCN and BERTcited by 74
- 2021ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Informationcited by 65
- 2020Augmenting Transformers with KNN-Based Composite Memory for Dialoguecited by 53
- 2021Fast Nearest Neighbor Machine Translationcited by 37
- 2021Efficient Retrieval Augmented Generation from Unstructured Knowledge for Task-Oriented Dialogcited by 33
- 2017Empower Sequence Labeling with Task-Aware Neural Language Modelcited by 28
- 2021GNN-LM: Language Modeling based on Global Contexts via GNNcited by 27
- 2019Hierarchically-Refined Label Attention Network for Sequence Labelingcited by 25
- 2019GCDT: A Global Context Enhanced Deep Transition Architecture for Sequence Labelingcited by 22
- 2021Dependency Parsing as MRC-based Span-Span Predictioncited by 13
- 2018Hybrid semi-Markov CRF for Neural Sequence Labelingcited by 9
- 2021Faster Nearest Neighbor Machine Translationcited by 8
Built on by
Citing papers per year: 2022: 3; 2023: 1; 2024: 1; 2025: 1.
6 papers.
- 2022Schema-aware Reference as Prompt Improves Data-Efficient Knowledge Graph Constructioncited by 6
- 2024FsPONER: Few-shot Prompt Optimization for Named Entity Recognition in Domain-specific Scenarioscited by 6
- 2023Federated Nearest Neighbor Machine Translationcited by 5
- 2022YATO: Yet Another deep learning based Text analysis Open toolkitcited by 2
- 2022End-to-End Entity Detection with Proposer and Regressorcited by 0
- 2025Label Distribution Learning-Enhanced Dual-KNN for Text Classificationcited by 0
- 2025Label Distribution Learning-Enhanced Dual-KNN for Text Classification6 Mar 2025
- 2024FsPONER: Few-shot Prompt Optimization for Named Entity Recognition in Domain-specific Scenarios10 Jul 2024
- 2023Federated Nearest Neighbor Machine Translation23 Feb 2023
- 2022Schema-aware Reference as Prompt Improves Data-Efficient Knowledge Graph Construction19 Oct 2022
- 2022End-to-End Entity Detection with Proposer and Regressor19 Oct 2022
- 2022YATO: Yet Another deep learning based Text analysis Open toolkit28 Sep 2022
Similar, not cited
Close in wording, no citation either way
- 2026NE-R1: Enhancing Named Entity Recognition Model via Reinforcement Learning
- 2021Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training
- 2024Learning Robust Named Entity Recognizers From Noisy Data With Retrieval Augmentation
- 2023Self-Improving for Zero-Shot Named Entity Recognition with Large Language Models
- 2024Improving Few-Shot Cross-Domain Named Entity Recognition by Instruction Tuning a Word-Embedding based Retrieval Augmented Large Language Model
- 2024Rethinking Negative Instances for Generative Named Entity Recognition
- 2024ReverseNER: A Self-Generated Example-Driven Framework for Zero-Shot Named Entity Recognition with Large Language Models
- 2023DAMO-NLP at SemEval-2023 Task 2: A Unified Retrieval-augmented System for Multilingual Named Entity Recognition