Hierarchical Relation-Guided Type-Sentence Alignment for Long-Tail Relation Extraction with Distant Supervision
Not on the map. Why?
Abstract (arXiv)
Distant supervision uses triple facts in knowledge graphs to label a corpus for relation extraction, leading to wrong labeling and long-tail problems. Some works use the hierarchy of relations for knowledge transfer to long-tail relations. However, a coarse-grained relation often implies only an attribute (e.g., domain or topic) of the distant fact, making it hard to discriminate relations based solely on sentence semantics. One solution is resorting to entity types, but open questions remain about how to fully leverage the information of entity types and how to align multi-granular entity types with sentences. In this work, we propose a novel model to enrich distantly-supervised sentences with entity types. It consists of (1) a pairwise type-enriched sentence encoding module injecting both context-free and -related backgrounds to alleviate sentence-level wrong labeling, and (2) a hierarchical type-sentence alignment module enriching a sentence with the triple fact's basic attributes to support long-tail relations. Our model achieves new state-of-the-art results in overall and long-tail performance on benchmarks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 19 Sep 2021.
Builds on
19 of 36 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016Layer Normalizationcited by 5,579
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
- 2019Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networkscited by 61
- 2018RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Informationcited by 47
- 2015Type-Constrained Representation Learning in Knowledge Graphscited by 34
- 2019Distant Supervision Relation Extraction with Intra-Bag and Inter-Bag Attentionscited by 27
7 more
- 2016Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attentioncited by 23
- 2019Self-Attention Enhanced Selective Gate with Entity-Aware Embedding for Distantly Supervised Relation Extractioncited by 18
- 2020Improving Entity Linking by Modeling Latent Entity Type Informationcited by 18
- 2019Looking Beyond Label Noise: Shifted Label Distribution Matters in Distantly Supervised Relation Extractioncited by 7
- 2019Improving Distantly-supervised Entity Typing with Compact Latent Space Clusteringcited by 4
- 2020Improving Long-Tail Relation Extraction with Collaborating Relation-Augmented Attentioncited by 4
- 2020InSRL: A Multi-view Learning Framework Fusing Multiple Information Sources for Distantly-supervised Relation Extractioncited by 4
Built on by
Not cited yet.