Modeling Multi-Granularity Hierarchical Features for Relation Extraction
Not on the map. Why?
Abstract (arXiv)
Relation extraction is a key task in Natural Language Processing (NLP), which aims to extract relations between entity pairs from given texts. Recently, relation extraction (RE) has achieved remarkable progress with the development of deep neural networks. Most existing research focuses on constructing explicit structured features using external knowledge such as knowledge graph and dependency tree. In this paper, we propose a novel method to extract multi-granularity features based solely on the original input sentences. We show that effective structured features can be attained even without external knowledge. Three kinds of features based on the input sentences are fully exploited, which are in entity mention level, segment level, and sentence level. All the three are jointly and hierarchically modeled. We evaluate our method on three public benchmarks: SemEval 2010 Task 8, Tacred, and Tacred Revisited. To verify the effectiveness, we apply our method to different encoders such as LSTM and BERT. Experimental results show that our method significantly outperforms existing state-of-the-art models that even use external knowledge. Extensive analyses demonstrate that the performance of our model is contributed by the capture of multi-granularity features and the model of their hierarchical structure. Code and data are available at urlhttps://github.com/xnliang98/sms.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 54 references that are in the map. First posted on arXiv 9 Apr 2022.
Builds on
31 of 54 references.
References · 31
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
- 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
- 2019Knowledge Enhanced Contextual Word Representationscited by 294
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
- 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
- 2019Simple BERT Models for Relation Extraction and Semantic Role Labelingcited by 154
- 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
19 more
- 2017Cross-Sentence N-ary Relation Extraction with Graph LSTMscited by 101
- 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
- 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
- 2019Enriching Pre-trained Language Model with Entity Information for Relation Classificationcited by 82
- 2019Attention Guided Graph Convolutional Networks for Relation Extractioncited by 82
- 2020Learning from Context or Names? An Empirical Study on Neural Relation Extractioncited by 75
- 2015Relation Classification via Recurrent Neural Networkcited by 46
- 2017Improved Neural Relation Detection for Knowledge Base Question Answeringcited by 44
- 2018Simultaneously Self-Attending to All Mentions for Full-Abstract Biological Relation Extractioncited by 42
- 2015Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Pathcited by 35
- 2020GDPNet: Refining Latent Multi-View Graph for Relation Extractioncited by 29
- 2018N-ary Relation Extraction using Graph State LSTMcited by 26
- 2019Improving Relation Extraction by Pre-trained Language Representationscited by 24
- 2019Extracting Multiple-Relations in One-Pass with Pre-Trained Transformerscited by 19
- 2019Effective Attention Modeling for Neural Relation Extractioncited by 10
- 2020Downstream Model Design of Pre-trained Language Model for Relation Extraction Taskcited by 7
- 2016Combining Recurrent and Convolutional Neural Networks for Relation Classificationcited by 5
- 2019Enhancing Relation Extraction Using Syntactic Indicators and Sentential Contextscited by 5
- 2020Efficient long-distance relation extraction with DG-SpanBERTcited by 5
Built on by
Citing papers per year: 2024: 1.
1 paper.