mlsanityData to 7 Oct 2026

How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?

arXiv 2305.01555 ↗First posted 2 May 2023cs.CL cs.AI cs.DBcited by 30

Not on the map. Why?

Abstract (arXiv)

Scaling language models have revolutionized widespread NLP tasks, yet little comprehensively explored few-shot relation extraction with large language models. In this paper, we investigate principal methodologies, in-context learning and data generation, for few-shot relation extraction via GPT-3.5 through exhaustive experiments. To enhance few-shot performance, we further propose task-related instructions and schema-constrained data generation. We observe that in-context learning can achieve performance on par with previous prompt learning approaches, and data generation with the large language model can boost previous solutions to obtain new state-of-the-art few-shot results on four widely-studied relation extraction datasets. We hope our work can inspire future research for the capabilities of large language models in few-shot relation extraction. Code is available in https://github.com/zjunlp/DeepKE/tree/main/example/llm.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 36 of its 51 references that are in the map. First posted on arXiv 2 May 2023.

Builds on

36 of 51 references.

References · 36

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  6. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  7. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  8. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  9. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  10. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
  11. 2022Galactica: A Large Language Model for Sciencecited by 736
  12. 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 580
24 more
  1. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  2. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
  3. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
  4. 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
  5. 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
  6. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  7. 2022Is GPT-3 a Good Data Annotator?cited by 208
  8. 2021Want To Reduce Labeling Cost? GPT-3 Can Helpcited by 196
  9. 2021GPT3Mix: Leveraging Large-scale Language Models for Text Augmentationcited by 185
  10. 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
  11. 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
  12. 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
  13. 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
  14. 2021An Improved Baseline for Sentence-level Relation Extractioncited by 80
  15. 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 73
  16. 2019OpenNRE: An Open and Extensible Toolkit for Neural Relation Extractioncited by 62
  17. 2022Generative Knowledge Graph Construction: A Reviewcited by 49
  18. 2021Relation Classification with Entity Type Restrictioncited by 31
  19. 2020GDPNet: Refining Latent Multi-View Graph for Relation Extractioncited by 29
  20. 2023CodeKGC: Code Language Model for Generative Knowledge Graph Constructioncited by 28
  21. 2021Exploring Task Difficulty for Few-Shot Relation Extractioncited by 24
  22. 2022Co-training Improves Prompt-based Learning for Large Language Modelscited by 24
  23. 2021Entity Concept-enhanced Few-shot Relation Extractioncited by 14
  24. 2022Generative Prompt Tuning for Relation Classificationcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 8; 2024: 10; 2025: 9; 2026: 3.

30 papers.

Sort:

By area:

  1. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  2. 2023When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Taskscited by 37
  3. 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 21
  4. 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 14
  5. 2025GLiREL -- Generalist Model for Zero-Shot Relation Extractioncited by 11
  6. 2025R1-RE: Cross-Domain Relation Extraction with RLVRcited by 11
  7. 2023Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Modelscited by 9
  8. 2024The Effects of Hallucinations in Synthetic Training Data for Relation Extractioncited by 7
  9. 2023Exploring & Exploiting High-Order Graph Structure for Sparse Knowledge Graph Completioncited by 4
  10. 2024PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extractioncited by 3
  11. 2024Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Modelscited by 3
  12. 2025Bridging Generative and Discriminative Learning: Few-Shot Relation Extraction via Two-Stage Knowledge-Guided Pre-trainingcited by 3
18 more
  1. 2023Enabling and Analyzing How to Efficiently Extract Information from Hybrid Long Documents with LLMscited by 2
  2. 2024Formulation Comparison for Timeline Construction using LLMscited by 2
  3. 2025Prompt to Protection: A Comparative Study of Multimodal LLMs in Construction Hazard Recognitioncited by 2
  4. 2023Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environmentcited by 1
  5. 2024A Few-Shot Approach for Relation Extraction Domain Adaptation using Large Language Modelscited by 1
  6. 2025Relation Extraction or Pattern Matching? Unravelling the Generalisation Limits of Language Models for Biographical REcited by 1
  7. 2025Generating Diverse Training Samples for Relation Extraction with Large Language Modelscited by 1
  8. 2026Structured Semantic Information Helps Retrieve Better Examples for In-Context Learning Applied to Few-Shot Relation Extractioncited by 1
  9. 2023Entity or Relation Embeddings? An Analysis of Encoding Strategies for Relation Extractioncited by 0
  10. 2024Empowering Few-Shot Relation Extraction with The Integration of Traditional RE Methods and Large Language Modelscited by 0
  11. 2024Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and Opportunitiescited by 0
  12. 2024Single Ground Truth Is Not Enough: Adding Flexibility to Aspect-Based Sentiment Analysis Evaluationcited by 0
  13. 2024Extract Information from Hybrid Long Documents Leveraging LLMs: A Framework and Datasetcited by 0
  14. 2025Hallucination-Resistant Relation Extraction via Dependency-Aware Sentence Simplification and Two-tiered Hierarchical Refinementcited by 0
  15. 2025M-BRe: Discovering Training Samples for Relation Extraction from Unlabeled Texts with Large Language Modelscited by 0
  16. 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extractioncited by 0
  17. 2026BoostTaxo: Zero-Shot Taxonomy Induction via Boosting-Style Agentic Reasoning and Constraint-Aware Calibrationcited by 0
  18. 2026Two-Stage Prompt Optimization for Few-Shot Relation Extraction: From Reasoning-Guided Search to Gradient-Guided Refinementcited by 0