How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?
Not on the map. Why?
Abstract (arXiv)
Scaling language models have revolutionized widespread NLP tasks, yet little comprehensively explored few-shot relation extraction with large language models. In this paper, we investigate principal methodologies, in-context learning and data generation, for few-shot relation extraction via GPT-3.5 through exhaustive experiments. To enhance few-shot performance, we further propose task-related instructions and schema-constrained data generation. We observe that in-context learning can achieve performance on par with previous prompt learning approaches, and data generation with the large language model can boost previous solutions to obtain new state-of-the-art few-shot results on four widely-studied relation extraction datasets. We hope our work can inspire future research for the capabilities of large language models in few-shot relation extraction. Code is available in https://github.com/zjunlp/DeepKE/tree/main/example/llm.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 36 of its 51 references that are in the map. First posted on arXiv 2 May 2023.
Builds on
36 of 51 references.
References · 36
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 580
24 more
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
- 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
- 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2022Is GPT-3 a Good Data Annotator?cited by 208
- 2021Want To Reduce Labeling Cost? GPT-3 Can Helpcited by 196
- 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 185
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
- 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
- 2021An Improved Baseline for Sentence-level Relation Extractioncited by 80
- 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 73
- 2019OpenNRE: An Open and Extensible Toolkit for Neural Relation Extractioncited by 62
- 2022Generative Knowledge Graph Construction: A Reviewcited by 49
- 2021Relation Classification with Entity Type Restrictioncited by 31
- 2020GDPNet: Refining Latent Multi-View Graph for Relation Extractioncited by 29
- 2023CodeKGC: Code Language Model for Generative Knowledge Graph Constructioncited by 28
- 2021Exploring Task Difficulty for Few-Shot Relation Extractioncited by 24
- 2022Co-training Improves Prompt-based Learning for Large Language Modelscited by 24
- 2021Entity Concept-enhanced Few-shot Relation Extractioncited by 14
- 2022Generative Prompt Tuning for Relation Classificationcited by 13
Built on by
Citing papers per year: 2023: 8; 2024: 10; 2025: 9; 2026: 3.
30 papers.
Sort:
By area:
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2023When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Taskscited by 37
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 21
- 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 14
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extractioncited by 11
- 2025R1-RE: Cross-Domain Relation Extraction with RLVRcited by 11
- 2023Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Modelscited by 9
- 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extractioncited by 7
- 2023Exploring & Exploiting High-Order Graph Structure for Sparse Knowledge Graph Completioncited by 4
- 2024PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extractioncited by 3
- 2024Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Modelscited by 3
- 2025Bridging Generative and Discriminative Learning: Few-Shot Relation Extraction via Two-Stage Knowledge-Guided Pre-trainingcited by 3
18 more
- 2023Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMscited by 2
- 2024Formulation Comparison for Timeline Construction using LLMscited by 2
- 2025Prompt to Protection: A Comparative Study of Multimodal LLMs in Construction Hazard Recognitioncited by 2
- 2023Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environmentcited by 1
- 2024A Few-Shot Approach for Relation Extraction Domain Adaptation using Large Language Modelscited by 1
- 2025Relation Extraction or Pattern Matching? Unravelling the Generalisation Limits of Language Models for Biographical REcited by 1
- 2025Generating Diverse Training Samples for Relation Extraction with Large Language Modelscited by 1
- 2026Structured Semantic Information Helps Retrieve Better Examples for In-Context Learning Applied to Few-Shot Relation Extractioncited by 1
- 2023Entity or Relation Embeddings? An Analysis of Encoding Strategies for Relation Extractioncited by 0
- 2024Empowering Few-Shot Relation Extraction with The Integration of Traditional RE Methods and Large Language Modelscited by 0
- 2024Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and Opportunitiescited by 0
- 2024Single Ground Truth Is Not Enough: Adding Flexibility to Aspect-Based Sentiment Analysis Evaluationcited by 0
- 2024Extract Information from Hybrid Long Documents Leveraging LLMs: A Framework and Datasetcited by 0
- 2025Hallucination-Resistant Relation Extraction via Dependency-Aware Sentence Simplification and Two-tiered Hierarchical Refinementcited by 0
- 2025M-BRe: Discovering Training Samples for Relation Extraction from Unlabeled Texts with Large Language Modelscited by 0
- 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extractioncited by 0
- 2026BoostTaxo: Zero-Shot Taxonomy Induction via Boosting-Style Agentic Reasoning and Constraint-Aware Calibrationcited by 0
- 2026Two-Stage Prompt Optimization for Few-Shot Relation Extraction: From Reasoning-Guided Search to Gradient-Guided Refinementcited by 0
- 2026Two-Stage Prompt Optimization for Few-Shot Relation Extraction: From Reasoning-Guided Search to Gradient-Guided Refinement28 Jun 2026
- 2026BoostTaxo: Zero-Shot Taxonomy Induction via Boosting-Style Agentic Reasoning and Constraint-Aware Calibration3 Apr 2026
- 2026Structured Semantic Information Helps Retrieve Better Examples for In-Context Learning Applied to Few-Shot Relation Extraction28 Jan 2026
- 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extraction7 Oct 2025
- 2025M-BRe: Discovering Training Samples for Relation Extraction from Unlabeled Texts with Large Language Models9 Sep 2025
- 2025Hallucination-Resistant Relation Extraction via Dependency-Aware Sentence Simplification and Two-tiered Hierarchical Refinement20 Aug 2025
- 2025R1-RE: Cross-Domain Relation Extraction with RLVR7 Jul 2025
- 2025Prompt to Protection: A Comparative Study of Multimodal LLMs in Construction Hazard Recognition9 Jun 2025
- 2025Generating Diverse Training Samples for Relation Extraction with Large Language Models29 May 2025
- 2025Relation Extraction or Pattern Matching? Unravelling the Generalisation Limits of Language Models for Biographical RE18 May 2025
- 2025Bridging Generative and Discriminative Learning: Few-Shot Relation Extraction via Two-Stage Knowledge-Guided Pre-training18 May 2025
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extraction6 Jan 2025
18 more
- 2024Extract Information from Hybrid Long Documents Leveraging LLMs: A Framework and Dataset28 Dec 2024
- 2024Single Ground Truth Is Not Enough: Adding Flexibility to Aspect-Based Sentiment Analysis Evaluation13 Oct 2024
- 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extraction10 Oct 2024
- 2024Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and Opportunities7 Sep 2024
- 2024A Few-Shot Approach for Relation Extraction Domain Adaptation using Large Language Models5 Aug 2024
- 2024Empowering Few-Shot Relation Extraction with The Integration of Traditional RE Methods and Large Language Models12 Jul 2024
- 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphs12 Jun 2024
- 2024Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Models4 Jun 2024
- 2024PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extraction30 May 2024
- 2024Formulation Comparison for Timeline Construction using LLMs1 Mar 2024
- 2023Large Language Models for Generative Information Extraction: A Survey29 Dec 2023
- 2023Entity or Relation Embeddings? An Analysis of Encoding Strategies for Relation Extraction18 Dec 2023
- 2023When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks15 Nov 2023
- 2023Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Models13 Nov 2023
- 2023Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environment16 Oct 2023
- 2023Exploring & Exploiting High-Order Graph Structure for Sparse Knowledge Graph Completion29 Jun 2023
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers3 Jun 2023
- 2023Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMs24 May 2023
- 2023Exploring & Exploiting High-Order Graph Structure for Sparse Knowledge Graph Completioncited by 4
- 2023Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environmentcited by 1
- 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extractioncited by 0
- 2026BoostTaxo: Zero-Shot Taxonomy Induction via Boosting-Style Agentic Reasoning and Constraint-Aware Calibrationcited by 0
- 2026Two-Stage Prompt Optimization for Few-Shot Relation Extraction: From Reasoning-Guided Search to Gradient-Guided Refinementcited by 0
- 2026Two-Stage Prompt Optimization for Few-Shot Relation Extraction: From Reasoning-Guided Search to Gradient-Guided Refinement28 Jun 2026
- 2026BoostTaxo: Zero-Shot Taxonomy Induction via Boosting-Style Agentic Reasoning and Constraint-Aware Calibration3 Apr 2026
- 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extraction7 Oct 2025
- 2023Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environment16 Oct 2023
- 2023Exploring & Exploiting High-Order Graph Structure for Sparse Knowledge Graph Completion29 Jun 2023
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
- 2023When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Taskscited by 37
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 21
- 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 14
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extractioncited by 11
- 2025R1-RE: Cross-Domain Relation Extraction with RLVRcited by 11
- 2023Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Modelscited by 9
- 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extractioncited by 7
- 2024PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extractioncited by 3
- 2024Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Modelscited by 3
- 2025Bridging Generative and Discriminative Learning: Few-Shot Relation Extraction via Two-Stage Knowledge-Guided Pre-trainingcited by 3
- 2023Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMscited by 2
12 most cited of 23 All 23 (JSON)
- 2026Structured Semantic Information Helps Retrieve Better Examples for In-Context Learning Applied to Few-Shot Relation Extraction28 Jan 2026
- 2025M-BRe: Discovering Training Samples for Relation Extraction from Unlabeled Texts with Large Language Models9 Sep 2025
- 2025R1-RE: Cross-Domain Relation Extraction with RLVR7 Jul 2025
- 2025Generating Diverse Training Samples for Relation Extraction with Large Language Models29 May 2025
- 2025Relation Extraction or Pattern Matching? Unravelling the Generalisation Limits of Language Models for Biographical RE18 May 2025
- 2025Bridging Generative and Discriminative Learning: Few-Shot Relation Extraction via Two-Stage Knowledge-Guided Pre-training18 May 2025
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extraction6 Jan 2025
- 2024Extract Information from Hybrid Long Documents Leveraging LLMs: A Framework and Dataset28 Dec 2024
- 2024Single Ground Truth Is Not Enough: Adding Flexibility to Aspect-Based Sentiment Analysis Evaluation13 Oct 2024
- 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extraction10 Oct 2024
- 2024Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and Opportunities7 Sep 2024
- 2024A Few-Shot Approach for Relation Extraction Domain Adaptation using Large Language Models5 Aug 2024
12 newest of 23 All 23 (JSON)