mlsanityData to 7 Oct 2026

Open Relation Modeling: Learning to Define Relations between Entities

arXiv 2108.09241 ↗First posted 20 Aug 2021cs.CL cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Relations between entities can be represented by different instances, e.g., a sentence containing both entities or a fact in a Knowledge Graph (KG). However, these instances may not well capture the general relations between entities, may be difficult to understand by humans, even may not be found due to the incompleteness of the knowledge source. In this paper, we introduce the Open Relation Modeling problem - given two entities, generate a coherent sentence describing the relation between them. To solve this problem, we propose to teach machines to generate definition-like relation descriptions by letting them learn from defining entities. Specifically, we fine-tune Pre-trained Language Models (PLMs) to produce definitions conditioned on extracted entity pairs. To help PLMs reason between entities and provide additional relational knowledge to PLMs for open relation modeling, we incorporate reasoning paths in KGs and include a reasoning path selection mechanism. Experimental results show that our model can generate concise but informative relation descriptions that capture the representative characteristics of entities.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 22 of its 43 references that are in the map. First posted on arXiv 20 Aug 2021.

Builds on

22 of 43 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  8. 2019Language Models as Knowledge Bases?cited by 1,922
  9. 2021GPT Understands, Toocited by 715
  10. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
  11. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  12. 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 439
10 more
  1. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
  2. 2020KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoningcited by 106
  3. 2019Evaluating Commonsense in Pre-trained Language Modelscited by 95
  4. 2020Language Models are Open Knowledge Graphscited by 95
  5. 2019Do Neural Language Representations Learn Physical Commonsense?cited by 62
  6. 2018Variational Knowledge Graph Reasoningcited by 27
  7. 2020Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-trainingcited by 24
  8. 2019What Does My QA Model Know? Devising Controlled Probes using Expert Knowledgecited by 19
  9. 2020DualTKB: A Dual Learning Bridge between Text and Knowledge Basecited by 9
  10. 2019Modeling Confidence in Sequence-to-Sequence Modelscited by 5

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 3; 2023: 3.

7 papers.