Unlocking Instructive In-Context Learning with Tabular Prompting for Relational Triple Extraction
Not on the map. Why?
Abstract (arXiv)
The in-context learning (ICL) for relational triple extraction (RTE) has achieved promising performance, but still encounters two key challenges: (1) how to design effective prompts and (2) how to select proper demonstrations. Existing methods, however, fail to address these challenges appropriately. On the one hand, they usually recast RTE task to text-to-text prompting formats, which is unnatural and results in a mismatch between the output format at the pre-training time and the inference time for large language models (LLMs). On the other hand, they only utilize surface natural language features and lack consideration of triple semantics in sample selection. These issues are blocking improved performance in ICL for RTE, thus we aim to tackle prompt designing and sample selection challenges simultaneously. To this end, we devise a tabular prompting for RTE (textscTableIE) which frames RTE task into a table generation task to incorporate explicit structured information into ICL, facilitating conversion of outputs to RTE structures. Then we propose instructive in-context learning (I2CL) which only selects and annotates a few samples considering internal triple semantics in massive unlabeled samples.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 19 of its 45 references that are in the map. First posted on arXiv 21 Feb 2024.
Builds on
19 of 45 references.
References · 19
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
7 more
- 2022Selective Annotation Makes Language Models Better Few-Shot Learnerscited by 243
- 2021Active Learning by Acquiring Contrastive Examplescited by 156
- 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2023Skill-Based Few-Shot Selection for In-Context Learningcited by 46
- 2019Low-resource Deep Entity Resolution with Transfer and Active Learningcited by 37
- 2022FastRE: Towards Fast Relation Extraction with Convolutional Encoder and Improved Cascade Binary Tagging Frameworkcited by 8
Built on by
Citing papers per year: 2024: 7.
7 papers.
- 2024Fast and Continual Knowledge Graph Embedding via Incremental LoRAcited by 14
- 2024Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractorscited by 13
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extractioncited by 6
- 2024Empirical Analysis of Dialogue Relation Extraction with Large Language Modelscited by 4
- 2024Domain-Hierarchy Adaptation via Chain of Iterative Reasoning for Few-shot Hierarchical Text Classificationcited by 2
- 2024DiVA-DocRE: A Discriminative and Voice-Aware Paradigm for Document-Level Relation Extractioncited by 0
- 2024GRL-Prompt: Towards Knowledge Graph based Prompt Optimization via Reinforcement Learningcited by 0
- 2024GRL-Prompt: Towards Knowledge Graph based Prompt Optimization via Reinforcement Learning19 Nov 2024
- 2024DiVA-DocRE: A Discriminative and Voice-Aware Paradigm for Document-Level Relation Extraction7 Sep 2024
- 2024Domain-Hierarchy Adaptation via Chain of Iterative Reasoning for Few-shot Hierarchical Text Classification12 Jul 2024
- 2024Fast and Continual Knowledge Graph Embedding via Incremental LoRA8 Jul 2024
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extraction27 Apr 2024
- 2024Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractors27 Apr 2024
- 2024Empirical Analysis of Dialogue Relation Extraction with Large Language Models27 Apr 2024