Enriching Pre-trained Language Model with Entity Information for Relation Classification
Not on the map. Why?
Abstract (arXiv)
Relation classification is an important NLP task to extract relations between entities. The state-of-the-art methods for relation classification are primarily based on Convolutional or Recurrent Neural Networks. Recently, the pre-trained BERT model achieves very successful results in many NLP classification / sequence labeling tasks. Relation classification differs from those tasks in that it relies on information of both the sentence and the two target entities. In this paper, we propose a model that both leverages the pre-trained BERT language model and incorporates information from the target entities to tackle the relation classification task. We locate the target entities and transfer the information through the pre-trained architecture and incorporate the corresponding encoding of the two entities. We achieve significant improvement over the state-of-the-art method on the SemEval-2010 task 8 relational dataset.
Key facts. Cited by 82 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 16; 2023: 16; 2024: 14; 2025: 7; 2026: 1.
82 papers.
Sort:
By area:
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021WRENCH: A Comprehensive Benchmark for Weak Supervisioncited by 96
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2022RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extractioncited by 60
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Reviewcited by 35
- 2023MatSci-NLP: Evaluating Scientific Language Models on Materials Science Language Tasks Using Text-to-Schema Modelingcited by 35
- 2021An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learningcited by 31
- 2022Summarization as Indirect Supervision for Relation Extractioncited by 31
- 2023Revisiting Large Language Models as Zero-shot Relation Extractorscited by 29
38 more
- 2022Looking Beyond IoCs: Automatically Extracting Attack Patterns from External CTIcited by 27
- 2021NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Predictioncited by 23
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 22
- 2023BERT Based Clinical Knowledge Extraction for Biomedical Knowledge Graph Construction and Analysiscited by 18
- 2022TAGPRIME: A Unified Framework for Relational Structure Extractioncited by 15
- 2023RE-Matching: A Fine-Grained Semantic Matching Method for Zero-Shot Relation Extractioncited by 13
- 2023Construction of Knowledge Graphs: State and Challengescited by 12
- 2022ACCoRD: A Multi-Document Approach to Generating Diverse Descriptions of Scientific Conceptscited by 10
- 2022The Leaf Clinical Trials Corpus: a new resource for query generation from clinical trial eligibility criteriacited by 10
- 2023On the Evolution of Knowledge Graphs: A Survey and Perspectivecited by 10
- 2024Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Promptingcited by 10
- 2021Multi-view Inference for Relation Extraction with Uncertain Knowledgecited by 8
- 2021Prompt-based Zero-shot Relation Extraction with Semantic Knowledge Augmentationcited by 8
- 2023Learning to Substitute Ingredients in Recipescited by 8
- 2024PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakerscited by 8
- 2021Exploring deep learning methods for recognizing rare diseases and their clinical manifestations from textscited by 7
- 2021Abstractified Multi-instance Learning (AMIL) for Biomedical Relation Extractioncited by 7
- 2021Knowledge-Augmented Language Models for Cause-Effect Relation Classificationcited by 7
- 2024CHisIEC: An Information Extraction Corpus for Ancient Chinese Historycited by 7
- 2024FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answeringcited by 7
- 2021A More Fine-Grained Aspect-Sentiment-Opinion Triplet Extraction Taskcited by 6
- 2022A Generative Model for Relation Extraction and Classificationcited by 5
- 2022It Takes Two Flints to Make a Fire: Multitask Learning of Neural Relation and Explanation Classifierscited by 5
- 2023Trace and Edit Relation Associations in GPTcited by 4
- 2021Counts@IITK at SemEval-2021 Task 8: SciBERT Based Entity And Semantic Relation Extraction For Scientific Datacited by 3
- 2024Guided Distant Supervision for Multilingual Relation Extraction Data: Adapting to a New Languagecited by 3
- 2021CO-NNECT: A Framework for Revealing Commonsense Knowledge Paths as Explicitations of Implicit Knowledge in Textscited by 2
- 2021Do Models Learn the Directionality of Relations? A New Evaluation: Relation Direction Recognitioncited by 2
- 2021R-BERT-CNN: Drug-target interactions extraction from biomedical literaturecited by 2
- 2022MedDistant19: Towards an Accurate Benchmark for Broad-Coverage Biomedical Relation Extractioncited by 2
- 2024Knowledge-Driven Cross-Document Relation Extractioncited by 2
- 2021EGFI: Drug-Drug Interaction Extraction and Generation with Fusion of Enriched Entity and Sentence Informationcited by 1
- 2021ASPER: Attention-based Approach to Extract Syntactic Patterns denoting Semantic Relations in Sentential Contextcited by 1
- 2021Speaker-Oriented Latent Structures for Dialogue-Based Relation Extractioncited by 1
- 2022Modeling Multi-Granularity Hierarchical Features for Relation Extractioncited by 1
- 2022TERMinator: A system for scientific texts processingcited by 1
- 2023Dynamic Multi-View Fusion Mechanism For Chinese Relation Extractioncited by 1
- 2023Open Set Relation Extraction via Unknown-Aware Trainingcited by 1
50 most cited of 82 All 82 (JSON)
- 2026Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction21 Jun 2026
- 2025Transformer Enhanced Relation Classification: A Comparative Analysis of Contextuality, Data Efficiency and Sequence Complexity14 Sep 2025
- 2025A Pluggable Multi-Task Learning Framework for Sentiment-Aware Financial Relation Extraction14 Jun 2025
- 2025Comparative Analysis of AI Agent Architectures for Entity Relationship Classification3 Jun 2025
- 2025Retrieval Augmented Generation based Large Language Models for Causality Mining29 May 2025
- 2025Reduction of Supervision for Biomedical Knowledge Discovery13 Apr 2025
- 2025Autoregressive Language Models for Knowledge Base Population: A case study in the space mission domain24 Mar 2025
- 2025CPTuning: Contrastive Prompt Tuning for Generative Relation Extraction4 Jan 2025
- 2024FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answering9 Dec 2024
- 2024ReverseNER: A Self-Generated Example-Driven Framework for Zero-Shot Named Entity Recognition with Large Language Models1 Nov 2024
- 2024SAKA: An Intelligent Platform for Semi-automated Knowledge Graph Construction and Application10 Oct 2024
- 2024PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers2 Oct 2024
38 more
- 2024Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting2 Oct 2024
- 2024Optimizing Ingredient Substitution Using Large Language Models to Enhance Phytochemical Content in Recipes13 Sep 2024
- 2024Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and Opportunities7 Sep 2024
- 2024KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning24 Jun 2024
- 2024Knowledge-Driven Cross-Document Relation Extraction22 May 2024
- 2024Enhancing Language Models for Financial Relation Extraction with Named Entities and Part-of-Speech2 May 2024
- 2024A Two Dimensional Feature Engineering Method for Relation Extraction7 Apr 2024
- 2024Guided Distant Supervision for Multilingual Relation Extraction Data: Adapting to a New Language25 Mar 2024
- 2024CHisIEC: An Information Extraction Corpus for Ancient Chinese History22 Mar 2024
- 2024Pointing out the Shortcomings of Relation Extraction Models with Semantically Motivated Adversarials29 Feb 2024
- 2023Trace and Edit Relation Associations in GPT30 Dec 2023
- 2023Revisiting Large Language Models as Zero-shot Relation Extractors8 Oct 2023
- 2023On the Evolution of Knowledge Graphs: A Survey and Perspective7 Oct 2023
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-44 Oct 2023
- 2023A ModelOps-based Framework for Intelligent Medical Knowledge Extraction4 Oct 2023
- 2023Multiple Relations Classification using Imbalanced Predictions Adaptation24 Sep 2023
- 2023Comparative Analysis of Contextual Relation Extraction based on Deep Learning Models13 Sep 2023
- 2023Stress Testing BERT Anaphora Resolution Models for Reaction Extraction in Chemical Patents23 Jun 2023
- 2023RE-Matching: A Fine-Grained Semantic Matching Method for Zero-Shot Relation Extraction8 Jun 2023
- 2023Open Set Relation Extraction via Unknown-Aware Training8 Jun 2023
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers3 Jun 2023
- 2023MatSci-NLP: Evaluating Scientific Language Models on Materials Science Language Tasks Using Text-to-Schema Modeling14 May 2023
- 2023BERT Based Clinical Knowledge Extraction for Biomedical Knowledge Graph Construction and Analysis21 Apr 2023
- 2023Dynamic Multi-View Fusion Mechanism For Chinese Relation Extraction9 Mar 2023
- 2023Construction of Knowledge Graphs: State and Challenges22 Feb 2023
- 2023Learning to Substitute Ingredients in Recipes15 Feb 2023
- 2022Learning with Silver Standard Data for Zero-shot Relation Extraction25 Nov 2022
- 2022Looking Beyond IoCs: Automatically Extracting Attack Patterns from External CTI1 Nov 2022
- 2022Semantic Novelty Detection and Characterization in Factual Text Involving Named Entities31 Oct 2022
- 2022TERMinator: A system for scientific texts processing29 Sep 2022
- 2022A Hybrid Model of Classification and Generation for Spatial Relation Extraction15 Aug 2022
- 2022The Leaf Clinical Trials Corpus: a new resource for query generation from clinical trial eligibility criteria27 Jul 2022
- 2022TAGPRIME: A Unified Framework for Relational Structure Extraction25 May 2022
- 2022Summarization as Indirect Supervision for Relation Extraction19 May 2022
- 2022ACCoRD: A Multi-Document Approach to Generating Diverse Descriptions of Scientific Concepts14 May 2022
- 2022It Takes Two Flints to Make a Fire: Multitask Learning of Neural Relation and Explanation Classifiers25 Apr 2022
- 2022MedDistant19: Towards an Accurate Benchmark for Broad-Coverage Biomedical Relation Extraction10 Apr 2022
- 2022Modeling Multi-Granularity Hierarchical Features for Relation Extraction9 Apr 2022
50 newest of 82 All 82 (JSON)
- 2022RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extractioncited by 60
- 2024FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answeringcited by 7
- 2024ReverseNER: A Self-Generated Example-Driven Framework for Zero-Shot Named Entity Recognition with Large Language Modelscited by 1
- 2024FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answering9 Dec 2024
- 2024ReverseNER: A Self-Generated Example-Driven Framework for Zero-Shot Named Entity Recognition with Large Language Models1 Nov 2024
- 2022RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction17 Mar 2022
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 319
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021WRENCH: A Comprehensive Benchmark for Weak Supervisioncited by 96
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2021ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learningcited by 46
- 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Reviewcited by 35
- 2023MatSci-NLP: Evaluating Scientific Language Models on Materials Science Language Tasks Using Text-to-Schema Modelingcited by 35
- 2021An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learningcited by 31
- 2022Summarization as Indirect Supervision for Relation Extractioncited by 31
- 2023Revisiting Large Language Models as Zero-shot Relation Extractorscited by 29
- 2022Looking Beyond IoCs: Automatically Extracting Attack Patterns from External CTIcited by 27
12 most cited of 76 All 76 (JSON)
- 2026Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction21 Jun 2026
- 2025Transformer Enhanced Relation Classification: A Comparative Analysis of Contextuality, Data Efficiency and Sequence Complexity14 Sep 2025
- 2025A Pluggable Multi-Task Learning Framework for Sentiment-Aware Financial Relation Extraction14 Jun 2025
- 2025Reduction of Supervision for Biomedical Knowledge Discovery13 Apr 2025
- 2025Autoregressive Language Models for Knowledge Base Population: A case study in the space mission domain24 Mar 2025
- 2025CPTuning: Contrastive Prompt Tuning for Generative Relation Extraction4 Jan 2025
- 2024SAKA: An Intelligent Platform for Semi-automated Knowledge Graph Construction and Application10 Oct 2024
- 2024PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers2 Oct 2024
- 2024Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting2 Oct 2024
- 2024Optimizing Ingredient Substitution Using Large Language Models to Enhance Phytochemical Content in Recipes13 Sep 2024
- 2024Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and Opportunities7 Sep 2024
- 2024Knowledge-Driven Cross-Document Relation Extraction22 May 2024
12 newest of 76 All 76 (JSON)