FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluation
Not on the map. Why?
Abstract (arXiv)
We present a Few-Shot Relation Classification Dataset (FewRel), consisting of 70, 000 sentences on 100 relations derived from Wikipedia and annotated by crowdworkers. The relation of each sentence is first recognized by distant supervision methods, and then filtered by crowdworkers. We adapt the most recent state-of-the-art few-shot learning methods for relation classification and conduct a thorough evaluation of these methods. Empirical results show that even the most competitive few-shot learning models struggle on this task, especially as compared with humans. We also show that a range of different reasoning skills are needed to solve our task. These results indicate that few-shot relation classification remains an open problem and still requires further research. Our detailed analysis points multiple directions for future research. All details and resources about the dataset and baselines are released on http://zhuhao.me/fewrel.
Key facts. Cited by 254 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 58; 2022: 66; 2023: 53; 2024: 44; 2025: 24; 2026: 9.
254 papers.
Sort:
By area:
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2022Is GPT-3 a Good Data Annotator?cited by 208
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
- 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 152
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2021KLUE: Korean Language Understanding Evaluationcited by 114
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
- 2021FLEX: Unifying Evaluation for Few-Shot NLPcited by 67
38 more
- 2021CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learningcited by 64
- 2024Towards Lifelong Learning of Large Language Models: A Surveycited by 64
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2022RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extractioncited by 60
- 2022Revisiting DocRED -- Addressing the False Negative Problem in Relation Extractioncited by 57
- 2021Neural Data Augmentation via Example Extrapolationcited by 54
- 2021Few-shot Conformal Prediction with Auxiliary Taskscited by 53
- 2021GenIE: Generative Information Extractioncited by 53
- 2023A Survey on Few-Shot Class-Incremental Learningcited by 48
- 2023Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Textcited by 48
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2024Recent Advances of Foundation Language Models-based Continual Learning: A Surveycited by 46
- 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
- 2023Instruct and Extract: Instruction Tuning for On-Demand Information Extractioncited by 36
- 2021Few-Shot Text Classification with Triplet Networks, Data Augmentation, and Curriculum Learningcited by 35
- 2021Curriculum-Meta Learning for Order-Robust Continual Relation Extractioncited by 34
- 2021Prototypical Representation Learning for Relation Extractioncited by 33
- 2021Knowledge Enhanced Pretrained Language Models: A Compreshensive Surveycited by 33
- 2021An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learningcited by 31
- 2022Inducing Positive Perspectives with Text Reframingcited by 31
- 2021Incremental Few-shot Text Classification with Multi-round New Classes: Formulation, Dataset and Systemcited by 30
- 2023How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?cited by 30
- 2023Revisiting Large Language Models as Zero-shot Relation Extractorscited by 29
- 2021Noisy-Labeled NER with Confidence Estimationcited by 28
- 2022Consistent Representation Learning for Continual Relation Extractioncited by 28
- 2021Revisiting Few-shot Relation Classification: Evaluation Data and Classification Schemescited by 27
- 2021An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labelingcited by 26
- 2021Visual Distant Supervision for Scene Graph Generationcited by 25
- 2021Exploring Task Difficulty for Few-Shot Relation Extractioncited by 24
- 2024ADELIE: Aligning Large Language Models on Information Extractioncited by 24
- 2021Revisiting Self-Training for Few-Shot Learning of Language Modelcited by 23
- 2021Zero-Shot Information Extraction as a Unified Text-to-Triple Translationcited by 22
- 2022Decomposed Meta-Learning for Few-Shot Named Entity Recognitioncited by 22
- 2022Label Semantics for Few Shot Named Entity Recognitioncited by 21
- 2022CrossRE: A Cross-Domain Dataset for Relation Extractioncited by 21
- 2023Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuningcited by 21
- 2023Zero-shot Referring Expression Comprehension via Structural Similarity Between Images and Captionscited by 21
- 2022MetaPrompting: Learning to Learn Better Promptscited by 19
50 most cited of 254 All 254 (JSON)
- 2026RAILS: Retrieval-Augmented Incremental LLM Clustering at Scale21 Sep 2026
- 2026SAGE: A Unified Algebra and Self-Adaptive Execution for AI Functions in SQL21 Aug 2026
- 2026Reversing Arrows in Large Language Models4 Aug 2026
- 2026Two-Stage Prompt Optimization for Few-Shot Relation Extraction: From Reasoning-Guided Search to Gradient-Guided Refinement28 Jun 2026
- 2026Tracing Relational Knowledge Recall in Large Language Models21 Apr 2026
- 2026LLM-based Atomic Propositions help weak extractors: Evaluation of a Propositioner for triplet extraction3 Apr 2026
- 2026A Study on Building Efficient Zero-Shot Relation Extraction Models1 Mar 2026
- 2026Structured Semantic Information Helps Retrieve Better Examples for In-Context Learning Applied to Few-Shot Relation Extraction28 Jan 2026
- 2026Document-Level Zero-Shot Relation Extraction with Entity Side Information12 Jan 2026
- 2025RFKG-CoT: Relation-Driven Adaptive Hop-count Selection and Few-Shot Path Guidance for Knowledge-Aware QA17 Dec 2025
- 2025SCIR: A Self-Correcting Iterative Refinement Framework for Enhanced Information Extraction Based on Schema13 Dec 2025
- 2025A systematic review of relation extraction task since the emergence of Transformers5 Nov 2025
38 more
- 2025Category Discovery: An Open-World Perspective26 Sep 2025
- 2025LLM-OREF: An Open Relation Extraction Framework Based on Large Language Models18 Sep 2025
- 2025Evaluating LLMs Without Oracle Feedback: Agentic Annotation Evaluation Through Unsupervised Consistency Signals10 Sep 2025
- 2025LLM-based Zero-shot Triple Extraction for Automated Ontology Generation from Software Engineering Standards29 Aug 2025
- 2025Learning Wisdom from Errors: Promoting LLM's Continual Relation Learning through Exploiting Error Cases16 Aug 2025
- 2025GLiDRE: Generalist Lightweight model for Document-level Relation Extraction1 Aug 2025
- 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledge4 Jul 2025
- 2025DISCIE -- Discriminative Closed Information Extraction19 Jun 2025
- 2025Analyzing the Influence of Knowledge Graph Information on Relation Extraction19 Jun 2025
- 2025Towards a More Generalized Approach in Open Relation Extraction28 May 2025
- 2025WAVE++: Capturing Within-Task Variance for Continual Relation Extraction with Adaptive Prompting20 May 2025
- 2025Relation Extraction Across Entire Books to Reconstruct Community Networks: The AffilKG Datasets16 May 2025
- 2025Reinforced Interactive Continual Learning via Real-time Noisy Human Feedback15 May 2025
- 2025Few-shot Hate Speech Detection Based on the MindSpore Framework22 Apr 2025
- 2025Post-Training Language Models for Continual Relation Extraction7 Apr 2025
- 2025Autoregressive Language Models for Knowledge Base Population: A case study in the space mission domain24 Mar 2025
- 2025GKG-LLM: A Unified Framework for Generalized Knowledge Graph Construction14 Mar 2025
- 2025Few-Shot, No Problem: Descriptive Continual Relation Extraction27 Feb 2025
- 2025GLEAN: Active Generalized Category Discovery with Diverse LLM Feedback25 Feb 2025
- 2025Few-shot Continual Relation Extraction via Open Information Extraction23 Feb 2025
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extraction6 Jan 2025
- 2024Adaptive Prompting for Continual Relation Extraction: A Within-Task Variance Perspective11 Dec 2024
- 2024Diversity Over Quantity: A Lesson From Few Shot Relation Classification6 Dec 2024
- 2024KnowCoder-X: Boosting Multilingual Information Extraction via Code7 Nov 2024
- 2024FACT: Examining the Effectiveness of Iterative Context Rewriting for Multi-fact Retrieval28 Oct 2024
- 2024Few-shot Open Relation Extraction with Gaussian Prototype and Adaptive Margin27 Oct 2024
- 2024Improve Meta-learning for Few-Shot Text Classification with All You Can Acquire from the Tasks14 Oct 2024
- 2024Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting2 Oct 2024
- 2024Preserving Generalization of Language models in Few-shot Continual Relation Extraction1 Oct 2024
- 2024RUIE: Retrieval-based Unified Information Extraction using Large Language Model18 Sep 2024
- 2024Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and Opportunities7 Sep 2024
- 2024Large Margin Prototypical Network for Few-shot Relation Classification with Fine-grained Features6 Sep 2024
- 2024Enhancing Graph Neural Networks with Limited Labeled Data by Actively Distilling Knowledge from Large Language Models19 Jul 2024
- 2024Large Language Model Enhanced Knowledge Representation Learning: A Survey1 Jul 2024
- 2024Adaptive Reinforcement Learning Planning: Harnessing Large Language Models for Complex Information Extraction17 Jun 2024
- 2024Fusion Makes Perfection: An Efficient Multi-Grained Matching Approach for Zero-Shot Relation Extraction17 Jun 2024
- 2024How Good are LLMs at Relation Extraction under Low-Resource Scenario? Comprehensive Evaluation17 Jun 2024
- 2024GLiNER multi-task: Generalist Lightweight Model for Various Information Extraction Tasks14 Jun 2024
50 newest of 254 All 254 (JSON)
- 2026Tracing Relational Knowledge Recall in Large Language Models21 Apr 2026
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2022Is GPT-3 a Good Data Annotator?cited by 208
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
- 2021Few-NERD: A Few-Shot Named Entity Recognition Datasetcited by 152
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2021KLUE: Korean Language Understanding Evaluationcited by 114
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extractioncited by 73
- 2021FLEX: Unifying Evaluation for Few-Shot NLPcited by 67
12 most cited of 240 All 240 (JSON)
- 2026SAGE: A Unified Algebra and Self-Adaptive Execution for AI Functions in SQL21 Aug 2026
- 2026Reversing Arrows in Large Language Models4 Aug 2026
- 2026LLM-based Atomic Propositions help weak extractors: Evaluation of a Propositioner for triplet extraction3 Apr 2026
- 2026A Study on Building Efficient Zero-Shot Relation Extraction Models1 Mar 2026
- 2026Structured Semantic Information Helps Retrieve Better Examples for In-Context Learning Applied to Few-Shot Relation Extraction28 Jan 2026
- 2026Document-Level Zero-Shot Relation Extraction with Entity Side Information12 Jan 2026
- 2025RFKG-CoT: Relation-Driven Adaptive Hop-count Selection and Few-Shot Path Guidance for Knowledge-Aware QA17 Dec 2025
- 2025SCIR: A Self-Correcting Iterative Refinement Framework for Enhanced Information Extraction Based on Schema13 Dec 2025
- 2025A systematic review of relation extraction task since the emergence of Transformers5 Nov 2025
- 2025Category Discovery: An Open-World Perspective26 Sep 2025
- 2025LLM-OREF: An Open Relation Extraction Framework Based on Large Language Models18 Sep 2025
- 2025LLM-based Zero-shot Triple Extraction for Automated Ontology Generation from Software Engineering Standards29 Aug 2025
12 newest of 240 All 240 (JSON)