FewRel 2.0: Towards More Challenging Few-Shot Relation Classification
Not on the map. Why?
Abstract (arXiv)
We present FewRel 2.0, a more challenging task to investigate two aspects of few-shot relation classification models: (1) Can they adapt to a new domain with only a handful of instances? (2) Can they detect none-of-the-above (NOTA) relations? To construct FewRel 2.0, we build upon the FewRel dataset (Han et al., 2018) by adding a new test set in a quite different domain, and a NOTA relation choice. With the new dataset and extensive experimental analysis, we found (1) that the state-of-the-art few-shot relation classification models struggle on these two aspects, and (2) that the commonly-used techniques for domain adaptation and NOTA detection still cannot handle the two challenges well. Our research calls for more attention and further efforts to these two real-world issues. All details and resources about the dataset and baselines are released at https: //github.com/thunlp/fewrel.
Key facts. Cited by 94 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 32; 2023: 22; 2024: 10; 2025: 5; 2026: 1.
94 papers.
Sort:
By area:
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 240
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 96
- 2023ClusterLLM: Large Language Models as a Guide for Text Clusteringcited by 69
- 2022Revisiting DocRED -- Addressing the False Negative Problem in Relation Extractioncited by 57
- 2021Neural Data Augmentation via Example Extrapolationcited by 54
- 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answeringcited by 51
- 2023Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Textcited by 48
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
- 2023Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractorscited by 44
38 more
- 2023When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Taskscited by 37
- 2021Prototypical Representation Learning for Relation Extractioncited by 33
- 2022Fixing Model Bugs with Natural Language Patchescited by 32
- 2021Revisiting Few-shot Relation Classification: Evaluation Data and Classification Schemescited by 27
- 2022Meta Learning for Natural Language Processing: A Surveycited by 26
- 2021Exploring Task Difficulty for Few-Shot Relation Extractioncited by 24
- 2021Zero-Shot Information Extraction as a Unified Text-to-Triple Translationcited by 22
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 21
- 2023Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuningcited by 21
- 2022CrossRE: A Cross-Domain Dataset for Relation Extractioncited by 20
- 2022What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classificationcited by 17
- 2021MapRE: An Effective Semantic Mapping Approach for Low-resource Relation Extractioncited by 16
- 2023A Survey of Imbalanced Learning on Graphs: Problems, Techniques, and Future Directionscited by 15
- 2021Entity Concept-enhanced Few-shot Relation Extractioncited by 14
- 2022UniRel: Unified Representation and Interaction for Joint Relational Triple Extractioncited by 14
- 2021Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Surveycited by 12
- 2022Few-shot learning for medical text: A systematic reviewcited by 12
- 2021Deep Neural Network Based Relation Extraction: An Overviewcited by 11
- 2022Few-Shot Document-Level Relation Extractioncited by 11
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extractioncited by 11
- 2021X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answeringcited by 10
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Datacited by 10
- 2021Knowledge-Aware Meta-learning for Low-Resource Text Classificationcited by 10
- 2021Diverse Distributions of Self-Supervised Tasks for Meta-Learning in NLPcited by 10
- 2022Information Extraction in Low-Resource Scenarios: Survey and Perspectivecited by 10
- 2022Active Relation Discovery: Towards General and Label-aware Open Relation Extractioncited by 10
- 2021Distantly-Supervised Long-Tailed Relation Extraction Using Constraint Graphscited by 9
- 2022A Distant Supervision Corpus for Extracting Biomedical Relationships Between Chemicals, Diseases and Genescited by 9
- 2022A Simple yet Effective Relation Information Guided Approach for Few-Shot Relation Extractioncited by 9
- 2022Pre-training to Match for Unified Low-shot Relation Extractioncited by 8
- 2022Better Few-Shot Relation Extraction with Label Prompt Dropoutcited by 8
- 2024GLiNER multi-task: Generalist Lightweight Model for Various Information Extraction Taskscited by 8
- 2022Label-enhanced Prototypical Network with Contrastive Learning for Multi-label Few-shot Aspect Category Detectioncited by 7
- 2021Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot Fillingcited by 6
- 2023Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extractioncited by 6
- 2023Plug-and-Play Knowledge Injection for Pre-trained Language Modelscited by 6
- 2024Best of Both Worlds: A Pliable and Generalizable Neuro-Symbolic Approach for Relation Classificationcited by 6
- 2022A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Modelscited by 5
50 most cited of 94 All 94 (JSON)
- 2026A Study on Building Efficient Zero-Shot Relation Extraction Models1 Mar 2026
- 2025LLM-MemCluster: Empowering Large Language Models with Dynamic Memory for Text Clustering19 Nov 2025
- 2025A systematic review of relation extraction task since the emergence of Transformers5 Nov 2025
- 2025GLiDRE: Generalist Lightweight model for Document-level Relation Extraction1 Aug 2025
- 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledge4 Jul 2025
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extraction6 Jan 2025
- 2024Diversity Over Quantity: A Lesson From Few Shot Relation Classification6 Dec 2024
- 2024ZeFaV: Boosting Large Language Models for Zero-shot Fact Verification18 Nov 2024
- 2024Few-shot Open Relation Extraction with Gaussian Prototype and Adaptive Margin27 Oct 2024
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey14 Jun 2024
- 2024GLiNER multi-task: Generalist Lightweight Model for Various Information Extraction Tasks14 Jun 2024
- 2024Towards Realistic Few-Shot Relation Extraction: A New Meta Dataset and Evaluation5 Apr 2024
38 more
- 2024READ: Improving Relation Extraction from an ADversarial Perspective2 Apr 2024
- 2024Efficient Information Extraction in Few-Shot Relation Classification through Contrastive Representation Learning25 Mar 2024
- 2024Towards Human-Like Machine Comprehension: Few-Shot Relational Learning in Visually-Rich Documents23 Mar 2024
- 2024Best of Both Worlds: A Pliable and Generalizable Neuro-Symbolic Approach for Relation Classification5 Mar 2024
- 2023Training on Synthetic Data Beats Real Data in Multimodal Relation Extraction5 Dec 2023
- 2023When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks15 Nov 2023
- 2023Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuning7 Nov 2023
- 2023A Few-Shot Learning Focused Survey on Recent Named Entity Recognition and Relation Classification Methods29 Oct 2023
- 2023CORE: A Few-Shot Company Relation Classification Dataset for Robust Domain Adaptation18 Oct 2023
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations11 Oct 2023
- 2023Comparative Analysis of Contextual Relation Extraction based on Deep Learning Models13 Sep 2023
- 2023TransPrompt v2: A Transferable Prompting Framework for Cross-task Text Classification29 Aug 2023
- 2023A Survey of Imbalanced Learning on Graphs: Problems, Techniques, and Future Directions26 Aug 2023
- 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering23 Aug 2023
- 2023Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Text4 Aug 2023
- 2023Zshot: An Open-source Framework for Zero-Shot Named Entity Recognition and Relation Extraction25 Jul 2023
- 2023Mutually Guided Few-shot Learning for Relational Triple Extraction23 Jun 2023
- 2023Open Set Relation Extraction via Unknown-Aware Training8 Jun 2023
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers3 Jun 2023
- 2023Plug-and-Play Knowledge Injection for Pre-trained Language Models28 May 2023
- 2023ClusterLLM: Large Language Models as a Guide for Text Clustering24 May 2023
- 2023Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors18 May 2023
- 2023Silver Syntax Pre-training for Cross-Domain Relation Extraction18 May 2023
- 2023Multi-CrossRE A Multi-Lingual Multi-Domain Dataset for Relation Extraction18 May 2023
- 2023Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction11 May 2023
- 2023PromptORE -- A Novel Approach Towards Fully Unsupervised Relation Extraction24 Mar 2023
- 2022Enriching Relation Extraction with OpenIE19 Dec 2022
- 2022Cross-Domain Few-Shot Relation Extraction via Representation Learning and Domain Adaptation5 Dec 2022
- 2022UniRel: Unified Representation and Interaction for Joint Relational Triple Extraction16 Nov 2022
- 2022Disentangling Task Relations for Few-shot Text Classification via Self-Supervised Hierarchical Task Clustering16 Nov 2022
- 2022Few-shot Classification with Hypersphere Modeling of Prototypes10 Nov 2022
- 2022Active Relation Discovery: Towards General and Label-aware Open Relation Extraction8 Nov 2022
- 2022Fixing Model Bugs with Natural Language Patches7 Nov 2022
- 2022BEKG: A Built Environment Knowledge Graph5 Nov 2022
- 2022Better Few-Shot Relation Extraction with Label Prompt Dropout25 Oct 2022
- 2022CrossRE: A Cross-Domain Dataset for Relation Extraction17 Oct 2022
- 2022RAPS: A Novel Few-Shot Relation Extraction Pipeline with Query-Information Guided Attention and Adaptive Prototype Fusion15 Oct 2022
- 2022A Sequence Tagging based Framework for Few-Shot Relation Extraction17 Aug 2022
50 newest of 94 All 94 (JSON)
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2023ClusterLLM: Large Language Models as a Guide for Text Clusteringcited by 69
- 2022Revisiting DocRED -- Addressing the False Negative Problem in Relation Extractioncited by 57
- 2021Neural Data Augmentation via Example Extrapolationcited by 54
- 2023FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answeringcited by 51
- 2023Text2KGBench: A Benchmark for Ontology-Driven Knowledge Graph Generation from Textcited by 48
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
- 2023Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractorscited by 44
- 2023When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Taskscited by 37
- 2021Prototypical Representation Learning for Relation Extractioncited by 33
12 most cited of 92 All 92 (JSON)
- 2026A Study on Building Efficient Zero-Shot Relation Extraction Models1 Mar 2026
- 2025LLM-MemCluster: Empowering Large Language Models with Dynamic Memory for Text Clustering19 Nov 2025
- 2025A systematic review of relation extraction task since the emergence of Transformers5 Nov 2025
- 2025GLiDRE: Generalist Lightweight model for Document-level Relation Extraction1 Aug 2025
- 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledge4 Jul 2025
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extraction6 Jan 2025
- 2024Diversity Over Quantity: A Lesson From Few Shot Relation Classification6 Dec 2024
- 2024ZeFaV: Boosting Large Language Models for Zero-shot Fact Verification18 Nov 2024
- 2024Few-shot Open Relation Extraction with Gaussian Prototype and Adaptive Margin27 Oct 2024
- 2024GLiNER multi-task: Generalist Lightweight Model for Various Information Extraction Tasks14 Jun 2024
- 2024Towards Realistic Few-Shot Relation Extraction: A New Meta Dataset and Evaluation5 Apr 2024
- 2024READ: Improving Relation Extraction from an ADversarial Perspective2 Apr 2024
12 newest of 92 All 92 (JSON)