Few-NERD: A Few-Shot Named Entity Recognition Dataset
Not on the map. Why?
Abstract (arXiv)
Recently, considerable literature has grown up around the theme of few-shot named entity recognition (NER), but little published benchmark data specifically focused on the practical and challenging task. Current approaches collect existing supervised NER datasets and re-organize them to the few-shot setting for empirical study. These strategies conventionally aim to recognize coarse-grained entity types with few examples, while in practice, most unseen entity types are fine-grained. In this paper, we present Few-NERD, a large-scale human-annotated few-shot NER dataset with a hierarchy of 8 coarse-grained and 66 fine-grained entity types. Few-NERD consists of 188,238 sentences from Wikipedia, 4,601,160 words are included and each is annotated as context or a part of a two-level entity type. To the best of our knowledge, this is the first few-shot NER dataset and the largest human-crafted NER dataset. We construct benchmark tasks with different emphases to comprehensively assess the generalization capability of models. Extensive empirical results and analysis show that Few-NERD is challenging and the problem requires further research. We make Few-NERD public at https://ningding97.github.io/fewnerd/.
Key facts. Cited by 150 papers in the map (data through 7 Oct 2026). Builds on 20 of its 42 references that are in the map. First posted on arXiv 16 May 2021.
Builds on
20 of 42 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
- 2020MAVEN: A Massive General Domain Event Detection Datasetcited by 103
- 2018Ultra-Fine Entity Typingcited by 87
8 more
- 2020Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Networkcited by 83
- 2018Few-shot classification in Named Entity Recognition Taskcited by 64
- 2019KBQA: Learning Question Answering over QA Corpora and Knowledge Basescited by 44
- 2020Few-Shot Named Entity Recognition: A Comprehensive Studycited by 41
- 2021Prototypical Representation Learning for Relation Extractioncited by 33
- 2014Context-Dependent Fine-Grained Entity Type Taggingcited by 30
- 2019NNE: A Dataset for Nested Named Entity Recognition in English Newswirecited by 25
- 2018Few-shot Learning for Named Entity Recognition in Medical Textcited by 19
Built on by
Citing papers per year: 2021: 10; 2022: 34; 2023: 45; 2024: 28; 2025: 17; 2026: 16.
150 papers.
Sort:
By area:
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
- 2024Long-context LLMs Struggle with Long In-context Learningcited by 285
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2021OpenPrompt: An Open-source Framework for Prompt-learningcited by 148
- 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
- 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
- 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 94
- 2023KoLA: Carefully Benchmarking World Knowledge of Large Language Modelscited by 85
- 2026Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Modelscited by 78
- 2021Template-free Prompt Tuning for Few-shot NERcited by 73
38 more
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
- 2023ClusterLLM: Large Language Models as a Guide for Text Clusteringcited by 69
- 2021CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learningcited by 64
- 2021Prompt-Learning for Fine-Grained Entity Typingcited by 62
- 2024Towards Lifelong Learning of Large Language Models: A Surveycited by 60
- 2022Prototypical Verbalizer for Prompt-based Few-shot Tuningcited by 53
- 2021Packed Levitated Marker for Entity and Relation Extractioncited by 49
- 2021Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NERcited by 38
- 2023When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Taskscited by 37
- 2022Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learningcited by 36
- 2023PromptNER: Prompting For Named Entity Recognitioncited by 35
- 2024Conformal Prediction Sets Improve Human Decision Makingcited by 35
- 2024NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Datacited by 34
- 2022WikiDiverse: A Multimodal Entity Linking Dataset with Diversified Contextual Topics and Entity Typescited by 33
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbationcited by 28
- 2021LightNER: A Lightweight Tuning Paradigm for Low-resource NER via Pluggable Promptingcited by 27
- 2021An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labelingcited by 26
- 2024ADELIE: Aligning Large Language Models on Information Extractioncited by 24
- 2022Decomposed Meta-Learning for Few-Shot Named Entity Recognitioncited by 22
- 2022Label Semantics for Few Shot Named Entity Recognitioncited by 21
- 2022Parallel Instance Query Network for Named Entity Recognitioncited by 19
- 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
- 2022Exploring the Role of Task Transferability in Large-Scale Multi-Task Learningcited by 17
- 2022Few-shot Named Entity Recognition with Entity-level Prototypical Network Enhanced by Dispersedly Distributed Prototypescited by 17
- 2023FiNER-ORD: Financial Named Entity Recognition Open Research Datasetcited by 17
- 2023PromptNER: Prompt Locating and Typing for Named Entity Recognitioncited by 17
- 2023ConPET: Continual Parameter-Efficient Tuning for Large Language Modelscited by 16
- 2023FindVehicle and VehicleFinder: A NER dataset for natural language-based vehicle retrieval and a keyword-based cross-modal vehicle retrieval systemcited by 15
- 2024MetaIE: Distilling a Meta Model from LLM for All Kinds of Information Extraction Taskscited by 14
- 2023MESED: A Multi-modal Entity Set Expansion Dataset with Fine-grained Semantic Classes and Hard Negative Entitiescited by 13
- 2023Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Modelscited by 13
- 2022HiNER: A Large Hindi Named Entity Recognition Datasetcited by 12
- 2022Prompt-Based Metric Learning for Few-Shot NERcited by 12
- 2023Hierarchical Verbalizer for Few-Shot Hierarchical Text Classificationcited by 11
- 2024LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognitioncited by 11
- 2021Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognitioncited by 10
- 2022Information Extraction in Low-Resource Scenarios: Survey and Perspectivecited by 10
50 most cited of 150 All 150 (JSON)
- 2026RAILS: Retrieval-Augmented Incremental LLM Clustering at Scale21 Sep 2026
- 2026Type-Balanced Contextual Learning for Incremental Named Entity Recognition31 Aug 2026
- 2026Pad=artha: Ontology-Grounded Fine-Grained NER Benchmark for Classical Sanskrit29 Aug 2026
- 2026FSE: Continual Learning for Named Entity Recognition by Fast-Slow Experts24 Jul 2026
- 2026CrimeNER Demo: Named-Entity Recognition in the Crime Domain16 Jul 2026
- 2026When Can Conformal Risk Control Certify LLM Outputs? Bounds, Impossibility, and Adaptation for Structured Generation27 Jun 2026
- 2026Narrative-UFET: Narrative Generation for Ultra-Fine Entity Typing25 Jun 2026
- 2026Scaling Performance and Low-Resource Annotation with Many-Shot In-Context Learning for Named Entity Recognition20 Jun 2026
- 2026Fine-Tuning Over Architectural Complexity: Broad-Coverage PII Detection on PIIBench with DeBERTa25 May 2026
- 2026YoNER: A New Yor`ub'a Multi-domain Named Entity Recognition Dataset7 Apr 2026
- 2026Beyond Logit Adjustment: A Residual Decomposition Framework for Long-Tailed Reranking2 Apr 2026
- 2026Named-Entity Recognition in the Crime Domain (CrimeNER): Case Study and Dataset2 Mar 2026
38 more
- 2026A Dataset for Named Entity Recognition and Relation Extraction from Art-historical Image Descriptions22 Feb 2026
- 2026AWED-PIPER: Agents, Web Applications & Expert Detectors for Personally Identifiable Information Protection & Fine-grained Named Entity Recognition across 36 languages for 6.6 Billion Speakers15 Jan 2026
- 2026Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models12 Jan 2026
- 2026Identifying Good and Bad Neurons for Task-Level Controllable LLMs8 Jan 2026
- 2025Retrieval-augmented Prompt Learning for Pre-trained Foundation Models23 Dec 2025
- 2025LLM-MemCluster: Empowering Large Language Models with Dynamic Memory for Text Clustering19 Nov 2025
- 2025TEXT2DB: Integration-Aware Information Extraction with Large Language Model Agents28 Oct 2025
- 2025GenCNER: A Generative Framework for Continual Named Entity Recognition13 Oct 2025
- 2025A Tale of LLMs and Induced Small Proxies: Scalable Small Language Models for Knowledge Mining1 Oct 2025
- 2025Hyperbolic Large Language Models6 Sep 2025
- 2025NER Retriever: Zero-Shot Named Entity Retrieval with Type-Aware Embeddings4 Sep 2025
- 2025Inference Gap in Domain Expertise and Machine Intelligence in Named Entity Recognition: Creation of and Insights from a Substance Use-related Dataset26 Aug 2025
- 2025Attention2Probability: Attention-Driven Terminology Probability Estimation for Robust Speech-to-Text System26 Aug 2025
- 2025ReProCon: Scalable and Resource-Efficient Few-Shot Biomedical Named Entity Recognition22 Aug 2025
- 2025Evaluating Sparse Autoencoders for Monosemantic Representation20 Aug 2025
- 2025ESNERA: Empirical and semantic named entity alignment for named entity dataset merging9 Aug 2025
- 2025AgriCHN: A Comprehensive Cross-domain Resource for Chinese Agricultural Named Entity Recognition21 Jun 2025
- 2025A Structured Literature Review on Traditional Approaches in Current Natural Language Processing19 May 2025
- 2025FLUKE: A Linguistically-Driven and Task-Agnostic Framework for Robustness Evaluation24 Apr 2025
- 2025Beyond Text: Characterizing Domain Expert Needs in Document Research16 Apr 2025
- 2025Mutual Understanding between People and Systems via Neurosymbolic AI and Knowledge Graphs15 Apr 2025
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks19 Dec 2024
- 2024BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognition3 Dec 2024
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Models27 Nov 2024
- 2024Improving Few-Shot Cross-Domain Named Entity Recognition by Instruction Tuning a Word-Embedding based Retrieval Augmented Large Language Model1 Nov 2024
- 2024DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition17 Sep 2024
- 2024RexUniNLU: Recursive Method with Explicit Schema Instructor for Universal NLU9 Sep 2024
- 2024Preserving Empirical Probabilities in BERT for Small-sample Clinical Entity Recognition5 Sep 2024
- 2024Acquiring Bidirectionality via Large and Small Language Models19 Aug 2024
- 2024Towards Lifelong Learning of Large Language Models: A Survey10 Jun 2024
- 2024Fighting Against the Repetitive Training and Sample Dependency Problem in Few-shot Named Entity Recognition8 Jun 2024
- 2024ADELIE: Aligning Large Language Models on Information Extraction8 May 2024
- 2024A Unified Label-Aware Contrastive Learning Framework for Few-Shot Named Entity Recognition26 Apr 2024
- 2024Hybrid Multi-stage Decoding for Few-shot NER with Entity-aware Contrastive Learning10 Apr 2024
- 2024Long-context LLMs Struggle with Long In-context Learning2 Apr 2024
- 2024MetaIE: Distilling a Meta Model from LLM for All Kinds of Information Extraction Tasks30 Mar 2024
- 2024Few-shot Named Entity Recognition via Superposition Concept Discrimination25 Mar 2024
- 2024Towards Human-Like Machine Comprehension: Few-Shot Relational Learning in Visually-Rich Documents23 Mar 2024
50 newest of 150 All 150 (JSON)
- 2022Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learningcited by 36
- 2024Improving Few-Shot Cross-Domain Named Entity Recognition by Instruction Tuning a Word-Embedding based Retrieval Augmented Large Language Modelcited by 5
- 2025Retrieval-augmented Prompt Learning for Pre-trained Foundation Modelscited by 0
- 2026RAILS: Retrieval-Augmented Incremental LLM Clustering at Scalecited by 0
- 2026RAILS: Retrieval-Augmented Incremental LLM Clustering at Scale21 Sep 2026
- 2025Retrieval-augmented Prompt Learning for Pre-trained Foundation Models23 Dec 2025
- 2024Improving Few-Shot Cross-Domain Named Entity Recognition by Instruction Tuning a Word-Embedding based Retrieval Augmented Large Language Model1 Nov 2024
- 2022Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learning29 May 2022
- 2024A Survey on Data Augmentation in Large Model Eracited by 31
- 2024A Survey on Data Augmentation in Large Model Era27 Jan 2024
- 2024Long-context LLMs Struggle with Long In-context Learningcited by 285
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2021OpenPrompt: An Open-source Framework for Prompt-learningcited by 148
- 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
- 2023Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluationscited by 96
- 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 94
- 2023KoLA: Carefully Benchmarking World Knowledge of Large Language Modelscited by 85
- 2021Template-free Prompt Tuning for Few-shot NERcited by 73
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
- 2023ClusterLLM: Large Language Models as a Guide for Text Clusteringcited by 69
12 most cited of 141 All 141 (JSON)
- 2026Type-Balanced Contextual Learning for Incremental Named Entity Recognition31 Aug 2026
- 2026Pad=artha: Ontology-Grounded Fine-Grained NER Benchmark for Classical Sanskrit29 Aug 2026
- 2026FSE: Continual Learning for Named Entity Recognition by Fast-Slow Experts24 Jul 2026
- 2026CrimeNER Demo: Named-Entity Recognition in the Crime Domain16 Jul 2026
- 2026When Can Conformal Risk Control Certify LLM Outputs? Bounds, Impossibility, and Adaptation for Structured Generation27 Jun 2026
- 2026Narrative-UFET: Narrative Generation for Ultra-Fine Entity Typing25 Jun 2026
- 2026Scaling Performance and Low-Resource Annotation with Many-Shot In-Context Learning for Named Entity Recognition20 Jun 2026
- 2026Fine-Tuning Over Architectural Complexity: Broad-Coverage PII Detection on PIIBench with DeBERTa25 May 2026
- 2026YoNER: A New Yor`ub'a Multi-domain Named Entity Recognition Dataset7 Apr 2026
- 2026Beyond Logit Adjustment: A Residual Decomposition Framework for Long-Tailed Reranking2 Apr 2026
- 2026Named-Entity Recognition in the Crime Domain (CrimeNER): Case Study and Dataset2 Mar 2026
- 2026A Dataset for Named Entity Recognition and Relation Extraction from Art-historical Image Descriptions22 Feb 2026
12 newest of 141 All 141 (JSON)