mlsanityData to 7 Oct 2026

KGPool: Dynamic Knowledge Graph Context Selection for Relation Extraction

arXiv 2106.00459 ↗First posted 1 Jun 2021cs.CL cs.AIcited by 12

Not on the map. Why?

Abstract (arXiv)

We present a novel method for relation extraction (RE) from a single sentence, mapping the sentence and two given entities to a canonical fact in a knowledge graph (KG). Especially in this presumed sentential RE setting, the context of a single sentence is often sparse. This paper introduces the KGPool method to address this sparsity, dynamically expanding the context with additional facts from the KG. It learns the representation of these facts (entity alias, entity descriptions, etc.) using neural methods, supplementing the sentential context. Unlike existing methods that statically use all expanded facts, KGPool conditions this expansion on the sentence. We study the efficacy of KGPool by evaluating it with different neural models and KGs (Wikidata and NYT Freebase). Our experimental evaluation on standard datasets shows that by feeding the KGPool representation into a Graph Neural Network, the overall method is significantly more accurate than state-of-the-art methods.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 23 of its 43 references that are in the map. First posted on arXiv 1 Jun 2021.

Builds on

23 of 43 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  5. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
  6. 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 786
  7. 2019Graph U-Netscited by 489
  8. 2019Self-Attention Graph Poolingcited by 421
  9. 2017Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphscited by 307
  10. 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
  11. 2018Towards Sparse Hierarchical Graph Classifierscited by 100
  12. 2018RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Informationcited by 47
11 more
  1. 2017Hybrid Approach of Relation Network and Localized Graph Convolutional Filtering for Breast Cancer Subtype Classificationcited by 40
  2. 2015Classifying Relations by Ranking with Convolutional Neural Networkscited by 33
  3. 2020RECON: Relation Extraction using Knowledge Graph Context in a Graph Neural Networkcited by 28
  4. 2019Graph Neural Networks with Generated Parameters for Relation Extractioncited by 27
  5. 2019Distant Supervision Relation Extraction with Intra-Bag and Inter-Bag Attentionscited by 27
  6. 2020Dynamic Context Selection for Document-level Neural Machine Translation via Reinforcement Learningcited by 25
  7. 2020Evaluating the Impact of Knowledge Graph Context on Entity Disambiguation Modelscited by 22
  8. 2020CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Modelscited by 11
  9. 2020Contextualized Graph Attention Network for Recommendation with Item Knowledge Graphcited by 10
  10. 2019Connecting Language and Knowledge with Heterogeneous Representations for Neural Relation Extractioncited by 9
  11. 2018Improving Distantly Supervised Relation Extraction with Neural Noise Converter and Conditional Optimal Selectorcited by 8

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 5; 2024: 1; 2025: 3.

12 papers.