mlsanityData to 14 Oct 2026

Latent Relation Language Models

arXiv 1908.07690 ↗First posted 21 Aug 2019cs.CLcited by 14

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose Latent Relation Language Models (LRLMs), a class of language models that parameterizes the joint distribution over the words in a document and the entities that occur therein via knowledge graph relations. This model has a number of attractive properties: it not only improves language modeling performance, but is also able to annotate the posterior probability of entity spans for a given text through relations. Experiments demonstrate empirical improvements over both a word-based baseline language model and a previous approach that incorporates knowledge graph information. Qualitative analysis further demonstrates the proposed model's ability to learn to predict appropriate relations in context.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Aug 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 7; 2022: 3; 2023: 3; 2024: 1.

14 papers.

Sort:

  1. 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
  2. 2021Knowledge Enhanced Pretrained Language Models: A Compreshensive Surveycited by 33
  3. 2021SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Miningcited by 24
  4. 2022Relational Memory Augmented Language Modelscited by 24
  5. 2021XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledgecited by 18
  6. 2021Capturing Structural Locality in Non-parametric Language Modelscited by 8
  7. 2021A Discriminative Entity-Aware Language Model for Virtual Assistantscited by 7
  8. 2022Space-Efficient Representation of Entity-centric Query Language Modelscited by 7
  9. 2023Modeling Spoken Information Queries for Virtual Assistants: Open Problems, Challenges and Opportunitiescited by 4
  10. 2021Language Model Evaluation in Open-ended Text Generationcited by 2
  11. 2022Open-domain Dialogue Generation Grounded with Dynamic Multi-form Knowledge Fusioncited by 2
  12. 2023RelBERT: Embedding Relations with Language Modelscited by 1
2 more
  1. 2021Knowledge Graph Completion with Text-aided Regularizationcited by 0
  2. 2024Empirical analysis of binding precedent efficiency in Brazilian Supreme Court via case classificationcited by 0